[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:52:59 dist-test-slave-44d2 krb5kdc[3476](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:52:59 dist-test-slave-44d2 krb5kdc[3476](info): set up 2 sockets
Aug 06 00:52:59 dist-test-slave-44d2 krb5kdc[3476](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 00:53:00.727882 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.378s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:00 dist-test-slave-44d2 krb5kdc[3476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:53:00.872938 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:41899
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:42989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:41899
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:01.001973 3492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:01.002279 3492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:01.002336 3492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:01.003865 3492 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:01.003961 3492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:01.003993 3492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:01.004024 3492 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:01.004061 3492 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:01.006256 3492 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:42989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:41899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:41899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:01.006755 3492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:01.007167 3492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:01.015261 3497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:01.016018 3498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:01.016583 3502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:01.016896 3492 server_base.cc:1034] running on GCE node
I20260806 00:53:01.017277 3492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:01.017694 3492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:01.018849 3492 hybrid_clock.cc:648] HybridClock initialized: now 1785977581018790 us; error 71 us; skew 500 ppm
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[3476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977581, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:01.022585 3492 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:53:01.023316 3492 webserver.cc:460] Webserver started at http://127.3.98.190:39701/ using document root <none> and password file <none>
I20260806 00:53:01.023644 3492 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:01.023728 3492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:01.023958 3492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:01.025708 3492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "2f8ffcd57fcc436d9945bd5de91870de"
format_stamp: "Formatted at 2026-08-06 00:53:01 on dist-test-slave-44d2"
server_key: "57cb5d8d16ee37bbac6836c16e11e8b0"
server_key_iv: "b99503504e57f3eb9cb7deb1099e673b"
server_key_version: "encryptionkey@0"
I20260806 00:53:01.026413 3492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "2f8ffcd57fcc436d9945bd5de91870de"
format_stamp: "Formatted at 2026-08-06 00:53:01 on dist-test-slave-44d2"
server_key: "57cb5d8d16ee37bbac6836c16e11e8b0"
server_key_iv: "b99503504e57f3eb9cb7deb1099e673b"
server_key_version: "encryptionkey@0"
I20260806 00:53:01.028800 3492 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260806 00:53:01.030208 3516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:01.030609 3492 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260806 00:53:01.030763 3492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "2f8ffcd57fcc436d9945bd5de91870de"
format_stamp: "Formatted at 2026-08-06 00:53:01 on dist-test-slave-44d2"
server_key: "57cb5d8d16ee37bbac6836c16e11e8b0"
server_key_iv: "b99503504e57f3eb9cb7deb1099e673b"
server_key_version: "encryptionkey@0"
I20260806 00:53:01.030890 3492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:01.054127 3492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:01.057636 3492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:01.057929 3492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:01.071460 3492 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:41899
I20260806 00:53:01.071542 3582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:41899 every 8 connection(s)
I20260806 00:53:01.072268 3492 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:01.072686 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 3492
I20260806 00:53:01.072813 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:01.073705 3466 external_mini_cluster.cc:1428] Setting key 7de177a73cc41d9186421ceb443bc29a
I20260806 00:53:01.074406 3583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:01.079993 3583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de: Bootstrap starting.
I20260806 00:53:01.081631 3583 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:01.082567 3583 log.cc:824] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:01.083582 3583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de: No bootstrap required, opened a new log
I20260806 00:53:01.087642 3583 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f8ffcd57fcc436d9945bd5de91870de" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41899 } }
I20260806 00:53:01.087875 3583 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:01.087997 3583 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f8ffcd57fcc436d9945bd5de91870de, State: Initialized, Role: FOLLOWER
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[3476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:01.088224 3583 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f8ffcd57fcc436d9945bd5de91870de" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41899 } }
I20260806 00:53:01.088404 3583 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:01.088445 3583 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:01.088510 3583 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:01.089582 3583 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f8ffcd57fcc436d9945bd5de91870de" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41899 } }
I20260806 00:53:01.089800 3583 leader_election.cc:302] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f8ffcd57fcc436d9945bd5de91870de; no voters:
I20260806 00:53:01.090087 3583 leader_election.cc:288] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:01.090348 3595 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:01.090654 3595 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [term 1 LEADER]: Becoming Leader. State: Replica: 2f8ffcd57fcc436d9945bd5de91870de, State: Running, Role: LEADER
I20260806 00:53:01.090664 3583 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:01.090975 3595 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f8ffcd57fcc436d9945bd5de91870de" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41899 } }
I20260806 00:53:01.092126 3596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f8ffcd57fcc436d9945bd5de91870de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f8ffcd57fcc436d9945bd5de91870de" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41899 } } }
I20260806 00:53:01.092366 3596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:01.093528 3605 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:01.094015 3598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f8ffcd57fcc436d9945bd5de91870de. Latest consensus state: current_term: 1 leader_uuid: "2f8ffcd57fcc436d9945bd5de91870de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f8ffcd57fcc436d9945bd5de91870de" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41899 } } }
I20260806 00:53:01.094273 3598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:01.094841 3605 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:01.096455 3588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:01.075176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51644 (local address 127.3.98.190:41899)
0806 00:53:01.075588 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:01.075597 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:01.075947 (+ 350us) server_negotiation.cc:407] Connection header received
0806 00:53:01.078641 (+ 2694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:01.078649 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:01.078741 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:01.078905 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:01.080836 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.082521 (+ 1685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.083964 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.084461 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.084683 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:01.089312 (+ 4629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:01.089316 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:01.089316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:01.089329 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:01.092724 (+ 3395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:01.093540 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:01.093542 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:01.093542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:01.093626 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:01.093991 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:01.093992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:01.093993 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:01.094493 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:01.095750 (+ 1257us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:01.095869 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 00:53:01.096108 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":214,"threads_started":1}
I20260806 00:53:01.098376 3605 catalog_manager.cc:1347] Generated new cluster ID: 458df94af8fa46c6b052ff0820509c82
I20260806 00:53:01.098445 3605 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:53:01.106091 3605 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:01.107084 3605 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:01.111510 3605 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f8ffcd57fcc436d9945bd5de91870de: Generated new TSK 0
I20260806 00:53:01.111931 3605 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:53:01.148779 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41899
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:42989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:01.250753 3627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:01.251004 3627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:01.251034 3627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:01.252358 3627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:01.252411 3627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:01.252442 3627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:01.254200 3627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:42989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41899
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:01.254562 3627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:01.254943 3627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:01.265954 3637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:01.266559 3635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:01.267073 3627 server_base.cc:1034] running on GCE node
W20260806 00:53:01.267369 3633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:01.267724 3627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:01.269618 3627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:01.270848 3627 hybrid_clock.cc:648] HybridClock initialized: now 1785977581270831 us; error 34 us; skew 500 ppm
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[3476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977581, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:01.274405 3627 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:53:01.275249 3627 webserver.cc:460] Webserver started at http://127.3.98.129:34197/ using document root <none> and password file <none>
I20260806 00:53:01.275633 3627 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:01.275708 3627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:01.275908 3627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:01.277343 3627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "4a9bab5d81814e8780a6d31d8f0f6037"
format_stamp: "Formatted at 2026-08-06 00:53:01 on dist-test-slave-44d2"
server_key: "a6a42ccfdc17517b7daf349bd2c8ed61"
server_key_iv: "a096c8cc39fffd109d83becf362fac24"
server_key_version: "encryptionkey@0"
I20260806 00:53:01.277814 3627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "4a9bab5d81814e8780a6d31d8f0f6037"
format_stamp: "Formatted at 2026-08-06 00:53:01 on dist-test-slave-44d2"
server_key: "a6a42ccfdc17517b7daf349bd2c8ed61"
server_key_iv: "a096c8cc39fffd109d83becf362fac24"
server_key_version: "encryptionkey@0"
I20260806 00:53:01.279668 3627 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 00:53:01.280857 3650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:01.281147 3627 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:01.281276 3627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "4a9bab5d81814e8780a6d31d8f0f6037"
format_stamp: "Formatted at 2026-08-06 00:53:01 on dist-test-slave-44d2"
server_key: "a6a42ccfdc17517b7daf349bd2c8ed61"
server_key_iv: "a096c8cc39fffd109d83becf362fac24"
server_key_version: "encryptionkey@0"
I20260806 00:53:01.281366 3627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:01.297147 3627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:01.299566 3627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:01.299749 3627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:01.300093 3627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:01.300594 3627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:01.300705 3627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:01.300752 3627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:01.300779 3627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:01.309511 3627 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:33193
I20260806 00:53:01.309552 3814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:33193 every 8 connection(s)
I20260806 00:53:01.309917 3627 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[3476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977581, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:01.317091 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 3627
I20260806 00:53:01.317221 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:01.317407 3466 external_mini_cluster.cc:1428] Setting key 8c8e06e5f63d7b5157851eb1f8e2c74b
I20260806 00:53:01.321236 3588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:01.310902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:45297 (local address 127.3.98.190:41899)
0806 00:53:01.311024 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:01.311026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:01.311246 (+ 220us) server_negotiation.cc:407] Connection header received
0806 00:53:01.311837 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:01.311839 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:01.311854 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:01.311906 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:01.313287 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.313843 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.314914 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.315142 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.315230 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:01.317669 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:01.317671 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:01.317671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:01.317681 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:01.319429 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:01.319867 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:01.319869 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:01.319869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:01.319944 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:01.320361 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:01.320378 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:01.320378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:01.320596 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:01.320669 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:01.321077 (+ 408us) server_negotiation.cc:299] Negotiation successful
0806 00:53:01.321168 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 00:53:01.321537 3817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:01.310805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41899 (local address 127.3.98.129:45297)
0806 00:53:01.311074 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:01.311133 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:01.311697 (+ 564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:01.312032 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:01.312036 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:01.312941 (+ 905us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:01.313166 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:01.313171 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.313968 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.313969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:01.314806 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:01.314809 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.315239 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.315240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:01.315376 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:01.315993 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:01.316002 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:01.317580 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:01.319522 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:01.319529 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:01.319531 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:01.319770 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:01.320078 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:01.320080 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:01.320080 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:01.320254 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:01.320679 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:01.320688 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:01.320872 (+ 184us) client_negotiation.cc:769] Sending connection context
0806 00:53:01.321031 (+ 159us) client_negotiation.cc:240] Negotiation successful
0806 00:53:01.321228 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":100,"threads_started":1}
I20260806 00:53:01.322156 3815 heartbeater.cc:347] Connected to a master server at 127.3.98.190:41899
I20260806 00:53:01.322283 3815 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:01.322499 3815 heartbeater.cc:511] Master 127.3.98.190:41899 requested a full tablet report, sending...
I20260806 00:53:01.323473 3539 ts_manager.cc:194] Registered new tserver with Master: 4a9bab5d81814e8780a6d31d8f0f6037 (127.3.98.129:33193)
I20260806 00:53:01.324230 3539 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:45297
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:53:01.347961 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41899
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:42989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:01.438020 3822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:01.438304 3822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:01.438349 3822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:01.439522 3822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:01.439603 3822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:01.439654 3822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:01.441310 3822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:42989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41899
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:01.441615 3822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:01.441875 3822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:01.447412 3830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:01.447533 3828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:01.447422 3827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:01.447786 3822 server_base.cc:1034] running on GCE node
I20260806 00:53:01.448024 3822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:01.448271 3822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:01.449440 3822 hybrid_clock.cc:648] HybridClock initialized: now 1785977581449422 us; error 28 us; skew 500 ppm
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[3476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977581, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:01.452116 3822 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:53:01.452708 3822 webserver.cc:460] Webserver started at http://127.3.98.130:42721/ using document root <none> and password file <none>
I20260806 00:53:01.452981 3822 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:01.453061 3822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:01.453226 3822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:01.454342 3822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "d50028f1a30141fd8c10a80164aff41f"
format_stamp: "Formatted at 2026-08-06 00:53:01 on dist-test-slave-44d2"
server_key: "94c034e9c6d693157888cdd22649fa82"
server_key_iv: "ce5e2330b55595d58b2d679b3d7bdd06"
server_key_version: "encryptionkey@0"
I20260806 00:53:01.454771 3822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "d50028f1a30141fd8c10a80164aff41f"
format_stamp: "Formatted at 2026-08-06 00:53:01 on dist-test-slave-44d2"
server_key: "94c034e9c6d693157888cdd22649fa82"
server_key_iv: "ce5e2330b55595d58b2d679b3d7bdd06"
server_key_version: "encryptionkey@0"
I20260806 00:53:01.456238 3822 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:53:01.457084 3846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:01.457264 3822 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:01.457370 3822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "d50028f1a30141fd8c10a80164aff41f"
format_stamp: "Formatted at 2026-08-06 00:53:01 on dist-test-slave-44d2"
server_key: "94c034e9c6d693157888cdd22649fa82"
server_key_iv: "ce5e2330b55595d58b2d679b3d7bdd06"
server_key_version: "encryptionkey@0"
I20260806 00:53:01.457494 3822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:01.473701 3822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:01.476464 3822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:01.476708 3822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:01.476975 3822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:01.477324 3822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:01.477388 3822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:01.477434 3822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:01.477468 3822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:01.484939 3822 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:45125
I20260806 00:53:01.484983 4004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:45125 every 8 connection(s)
I20260806 00:53:01.485390 3822 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[3476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977581, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:01.493714 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 3822
I20260806 00:53:01.493842 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:01.494143 3466 external_mini_cluster.cc:1428] Setting key beea1ec3ecfcb93f52a2e7f80c63d0a8
I20260806 00:53:01.495253 3588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:01.486311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:46339 (local address 127.3.98.190:41899)
0806 00:53:01.486381 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:01.486383 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:01.486613 (+ 230us) server_negotiation.cc:407] Connection header received
0806 00:53:01.487100 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:01.487101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:01.487112 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:01.487174 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:01.488154 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.488746 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.489716 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.489894 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.489944 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:01.492246 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:01.492248 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:01.492248 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:01.492255 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:01.493683 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:01.494184 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:01.494185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:01.494186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:01.494273 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:01.494529 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:01.494529 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:01.494530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:01.494676 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:01.494748 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:01.495118 (+ 370us) server_negotiation.cc:299] Negotiation successful
0806 00:53:01.495189 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 00:53:01.495581 4007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:01.486265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41899 (local address 127.3.98.130:46339)
0806 00:53:01.486468 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:01.486513 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:01.487001 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:01.487229 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:01.487232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:01.487851 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:01.488060 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:01.488065 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.488832 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.488833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:01.489639 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:01.489641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.489972 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.489973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:01.490074 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:01.490599 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:01.490610 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:01.492157 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:01.493771 (+ 1614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:01.493778 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:01.493781 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:01.494107 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:01.494349 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:01.494350 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:01.494350 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:01.494476 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:01.494774 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:01.494781 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:01.494951 (+ 170us) client_negotiation.cc:769] Sending connection context
0806 00:53:01.495092 (+ 141us) client_negotiation.cc:240] Negotiation successful
0806 00:53:01.495283 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":85,"threads_started":1}
I20260806 00:53:01.496259 4005 heartbeater.cc:347] Connected to a master server at 127.3.98.190:41899
I20260806 00:53:01.496381 4005 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:01.496632 4005 heartbeater.cc:511] Master 127.3.98.190:41899 requested a full tablet report, sending...
I20260806 00:53:01.497211 3539 ts_manager.cc:194] Registered new tserver with Master: d50028f1a30141fd8c10a80164aff41f (127.3.98.130:45125)
I20260806 00:53:01.497823 3539 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:46339
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:53:01.523721 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41899
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:42989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:01.616784 4013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:01.617010 4013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:01.617036 4013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:01.618278 4013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:01.618331 4013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:01.618361 4013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:01.619781 4013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:42989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41899
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:01.619982 4013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:01.620165 4013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:01.626253 4026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:01.626271 4022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:01.626313 4013 server_base.cc:1034] running on GCE node
W20260806 00:53:01.626276 4021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:01.626693 4013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:01.626896 4013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:01.628073 4013 hybrid_clock.cc:648] HybridClock initialized: now 1785977581628058 us; error 31 us; skew 500 ppm
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[3476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977581, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:01.630818 4013 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:53:01.631305 4013 webserver.cc:460] Webserver started at http://127.3.98.131:37617/ using document root <none> and password file <none>
I20260806 00:53:01.631510 4013 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:01.631556 4013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:01.631655 4013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:01.633025 4013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "45e68a31a57547d1a746ea86fd6a1805"
format_stamp: "Formatted at 2026-08-06 00:53:01 on dist-test-slave-44d2"
server_key: "0b3ef8d225af25f02664e1b9f240948f"
server_key_iv: "f2704635df004c91f0254b8bdf95480f"
server_key_version: "encryptionkey@0"
I20260806 00:53:01.633389 4013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "45e68a31a57547d1a746ea86fd6a1805"
format_stamp: "Formatted at 2026-08-06 00:53:01 on dist-test-slave-44d2"
server_key: "0b3ef8d225af25f02664e1b9f240948f"
server_key_iv: "f2704635df004c91f0254b8bdf95480f"
server_key_version: "encryptionkey@0"
I20260806 00:53:01.635215 4013 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 00:53:01.636132 4037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:01.636358 4013 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:01.636471 4013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "45e68a31a57547d1a746ea86fd6a1805"
format_stamp: "Formatted at 2026-08-06 00:53:01 on dist-test-slave-44d2"
server_key: "0b3ef8d225af25f02664e1b9f240948f"
server_key_iv: "f2704635df004c91f0254b8bdf95480f"
server_key_version: "encryptionkey@0"
I20260806 00:53:01.636603 4013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:01.657231 4013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:01.659365 4013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:01.659533 4013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:01.659816 4013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:01.660172 4013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:01.660233 4013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:01.660279 4013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:01.660305 4013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:01.668466 4013 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:42655
I20260806 00:53:01.668671 4196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:42655 every 8 connection(s)
I20260806 00:53:01.669073 4013 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:01.670190 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 4013
I20260806 00:53:01.670286 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:01.670473 3466 external_mini_cluster.cc:1428] Setting key 2114d2f80f850fda0c4ecb93d86abea5
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[3476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977581, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:01.679788 3588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:01.670088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:48537 (local address 127.3.98.190:41899)
0806 00:53:01.670143 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:01.670144 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:01.670495 (+ 351us) server_negotiation.cc:407] Connection header received
0806 00:53:01.671185 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:01.671185 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:01.671195 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:01.671224 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:01.672442 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.673063 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.674233 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.674433 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.674502 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:01.677105 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:01.677107 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:01.677107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:01.677114 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:01.678463 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:01.678881 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:01.678882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:01.678882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:01.678935 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:01.679209 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:01.679210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:01.679210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:01.679315 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:01.679366 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:01.679648 (+ 282us) server_negotiation.cc:299] Negotiation successful
0806 00:53:01.679717 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:53:01.680076 4200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:01.670104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41899 (local address 127.3.98.131:48537)
0806 00:53:01.670303 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:01.670371 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:01.671064 (+ 693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:01.671296 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:01.671299 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:01.672118 (+ 819us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:01.672349 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:01.672355 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.673168 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.673169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:01.674135 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:01.674138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.674542 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.674543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:01.674662 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:01.675280 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:01.675290 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:01.677009 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:01.678546 (+ 1537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:01.678553 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:01.678555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:01.678798 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:01.679020 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:01.679021 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:01.679022 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:01.679140 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:01.679378 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:01.679384 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:01.679514 (+ 130us) client_negotiation.cc:769] Sending connection context
0806 00:53:01.679613 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 00:53:01.679758 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":99,"threads_started":1}
I20260806 00:53:01.680658 4197 heartbeater.cc:347] Connected to a master server at 127.3.98.190:41899
I20260806 00:53:01.680792 4197 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:01.681037 4197 heartbeater.cc:511] Master 127.3.98.190:41899 requested a full tablet report, sending...
I20260806 00:53:01.681514 3539 ts_manager.cc:194] Registered new tserver with Master: 45e68a31a57547d1a746ea86fd6a1805 (127.3.98.131:42655)
I20260806 00:53:01.681902 3539 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:48537
I20260806 00:53:01.683037 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[3476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977581, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[3476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977581, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.98.129@KRBTEST.COM
I20260806 00:53:01.709101 4206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:01.700802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45566 (local address 127.3.98.129:33193)
0806 00:53:01.701026 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:01.701031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:01.701041 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:01.701071 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:01.701073 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:01.701090 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:01.701158 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:01.701757 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.702487 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.703252 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.703563 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.703632 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:01.706141 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:01.706150 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:01.706151 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:01.706158 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:01.707883 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:01.708240 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:01.708243 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:01.708244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:01.708313 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:01.708572 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:01.708578 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:01.708579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:01.708742 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:01.708861 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:01.708937 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 00:53:01.709016 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":136,"threads_started":1}
W20260806 00:53:01.709642 3688 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45566
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[3476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[3476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.129@KRBTEST.COM
I20260806 00:53:01.736719 4206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:01.728800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45570 (local address 127.3.98.129:33193)
0806 00:53:01.728909 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:01.728911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:01.728968 (+ 57us) server_negotiation.cc:407] Connection header received
0806 00:53:01.729053 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:01.729054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:01.729064 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:01.729121 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:01.729766 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.730251 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.731069 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:01.731266 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:01.731318 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:01.733801 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:01.733802 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:01.733803 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:01.733811 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:01.735408 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:01.735791 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:01.735792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:01.735793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:01.735890 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:01.736123 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:01.736125 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:01.736125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:01.736234 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:01.736366 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:01.736509 (+ 143us) server_negotiation.cc:299] Negotiation successful
0806 00:53:01.736600 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 00:53:01.737296 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 3627
I20260806 00:53:01.749974 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 3822
I20260806 00:53:01.765712 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 4013
I20260806 00:53:01.775143 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 3492
2026-08-06T00:53:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2459 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[4215](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[4215](info): set up 2 sockets
Aug 06 00:53:01 dist-test-slave-44d2 krb5kdc[4215](info): commencing operation
krb5kdc: starting...
W20260806 00:53:03.099375 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.298s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:03 dist-test-slave-44d2 krb5kdc[4215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:53:03.227074 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:35995
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:35995
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:03.312770 4236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:03.313001 4236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:03.313025 4236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:03.314149 4236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:03.314190 4236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:03.314205 4236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:03.314218 4236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:03.314230 4236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:03.315768 4236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:35995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:35995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:03.316010 4236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:03.316217 4236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:03.321244 4244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:03.321251 4248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:03.321285 4246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:03.321614 4236 server_base.cc:1034] running on GCE node
I20260806 00:53:03.321871 4236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:03.322183 4236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:03.323367 4236 hybrid_clock.cc:648] HybridClock initialized: now 1785977583323339 us; error 56 us; skew 500 ppm
Aug 06 00:53:03 dist-test-slave-44d2 krb5kdc[4215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977583, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:03.326059 4236 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:53:03.326622 4236 webserver.cc:460] Webserver started at http://127.3.98.190:46873/ using document root <none> and password file <none>
I20260806 00:53:03.326885 4236 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:03.326958 4236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:03.327123 4236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:03.328197 4236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "825c57e285584851ac0da47346f321fa"
format_stamp: "Formatted at 2026-08-06 00:53:03 on dist-test-slave-44d2"
server_key: "251ef9d17e305cf5c1901fe473be1e1d"
server_key_iv: "84c94b8f45296fab8d61fa3eef378303"
server_key_version: "encryptionkey@0"
I20260806 00:53:03.328631 4236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "825c57e285584851ac0da47346f321fa"
format_stamp: "Formatted at 2026-08-06 00:53:03 on dist-test-slave-44d2"
server_key: "251ef9d17e305cf5c1901fe473be1e1d"
server_key_iv: "84c94b8f45296fab8d61fa3eef378303"
server_key_version: "encryptionkey@0"
I20260806 00:53:03.330034 4236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:03.330806 4258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:03.330987 4236 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:03.331117 4236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "825c57e285584851ac0da47346f321fa"
format_stamp: "Formatted at 2026-08-06 00:53:03 on dist-test-slave-44d2"
server_key: "251ef9d17e305cf5c1901fe473be1e1d"
server_key_iv: "84c94b8f45296fab8d61fa3eef378303"
server_key_version: "encryptionkey@0"
I20260806 00:53:03.331199 4236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:03.347230 4236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:03.349270 4236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:03.349452 4236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:03.353984 4236 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:35995
I20260806 00:53:03.354051 4335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:35995 every 8 connection(s)
I20260806 00:53:03.354475 4236 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:03.355484 4336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:03.358269 4336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa: Bootstrap starting.
I20260806 00:53:03.358914 4336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:03.359267 4336 log.cc:824] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:03.360188 4336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa: No bootstrap required, opened a new log
I20260806 00:53:03.362185 4336 raft_consensus.cc:348] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825c57e285584851ac0da47346f321fa" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35995 } }
I20260806 00:53:03.362345 4336 raft_consensus.cc:374] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:03.362373 4336 raft_consensus.cc:729] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 825c57e285584851ac0da47346f321fa, State: Initialized, Role: FOLLOWER
I20260806 00:53:03.362573 4336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825c57e285584851ac0da47346f321fa" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35995 } }
I20260806 00:53:03.362658 4336 raft_consensus.cc:388] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:03.362641 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 4236
I20260806 00:53:03.362709 4336 raft_consensus.cc:482] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:03.362737 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:03.362764 4336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:03.362908 3466 external_mini_cluster.cc:1428] Setting key 0f34d3fb541a76dfebba35ce59943437
I20260806 00:53:03.363540 4336 raft_consensus.cc:504] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825c57e285584851ac0da47346f321fa" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35995 } }
I20260806 00:53:03.363760 4336 leader_election.cc:302] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 825c57e285584851ac0da47346f321fa; no voters:
I20260806 00:53:03.363996 4336 leader_election.cc:288] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:03.364023 4343 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:03.364306 4343 raft_consensus.cc:686] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [term 1 LEADER]: Becoming Leader. State: Replica: 825c57e285584851ac0da47346f321fa, State: Running, Role: LEADER
I20260806 00:53:03.364444 4336 sys_catalog.cc:564] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:03.364475 4343 consensus_queue.cc:237] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825c57e285584851ac0da47346f321fa" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35995 } }
I20260806 00:53:03.365438 4343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 825c57e285584851ac0da47346f321fa. Latest consensus state: current_term: 1 leader_uuid: "825c57e285584851ac0da47346f321fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825c57e285584851ac0da47346f321fa" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35995 } } }
I20260806 00:53:03.365615 4343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:03.366114 4357 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:03.366660 4345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "825c57e285584851ac0da47346f321fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "825c57e285584851ac0da47346f321fa" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35995 } } }
I20260806 00:53:03.366801 4357 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:03.366817 4345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:03.368567 4357 catalog_manager.cc:1347] Generated new cluster ID: 65271f8d0fe548a894cec6a88eb34580
I20260806 00:53:03.368686 4357 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:53:03 dist-test-slave-44d2 krb5kdc[4215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:03.375219 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.363480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48668 (local address 127.3.98.190:35995)
0806 00:53:03.363683 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:03.363692 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:03.363723 (+ 31us) server_negotiation.cc:407] Connection header received
0806 00:53:03.363822 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:03.363827 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:03.363893 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:03.364062 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:03.364813 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.366230 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.367322 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.367933 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.368043 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.370970 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:03.370974 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:03.370975 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:03.370989 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:03.373308 (+ 2319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:03.373752 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:03.373756 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:03.373757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:03.373889 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:03.374113 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:03.374114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:03.374114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:03.374445 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:03.374628 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:03.374735 (+ 107us) server_negotiation.cc:299] Negotiation successful
0806 00:53:03.375002 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":109,"threads_started":1}
I20260806 00:53:03.382985 4357 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:03.383709 4357 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:03.392906 4357 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 825c57e285584851ac0da47346f321fa: Generated new TSK 0
I20260806 00:53:03.393115 4357 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:53:03.431563 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35995
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:03.518185 4372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:03.518437 4372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:03.518476 4372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:03.519629 4372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:03.519667 4372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:03.519693 4372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:03.521277 4372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35995
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:03.521503 4372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:03.521692 4372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:03.526782 4382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:03.526808 4377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:03.526854 4379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:03.527127 4372 server_base.cc:1034] running on GCE node
I20260806 00:53:03.527362 4372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:03.527609 4372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:03.528752 4372 hybrid_clock.cc:648] HybridClock initialized: now 1785977583528731 us; error 37 us; skew 500 ppm
Aug 06 00:53:03 dist-test-slave-44d2 krb5kdc[4215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977583, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:03.531373 4372 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:53:03.531877 4372 webserver.cc:460] Webserver started at http://127.3.98.129:38373/ using document root <none> and password file <none>
I20260806 00:53:03.532135 4372 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:03.532207 4372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:03.532358 4372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:03.533506 4372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "c41651e4dead4a0bba6702bb7fedb1f5"
format_stamp: "Formatted at 2026-08-06 00:53:03 on dist-test-slave-44d2"
server_key: "ab24237adc3a1a7c8f74c40de7356220"
server_key_iv: "fc4629fc469ef9a72f1cd4d238f6df81"
server_key_version: "encryptionkey@0"
I20260806 00:53:03.533919 4372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "c41651e4dead4a0bba6702bb7fedb1f5"
format_stamp: "Formatted at 2026-08-06 00:53:03 on dist-test-slave-44d2"
server_key: "ab24237adc3a1a7c8f74c40de7356220"
server_key_iv: "fc4629fc469ef9a72f1cd4d238f6df81"
server_key_version: "encryptionkey@0"
I20260806 00:53:03.535471 4372 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:03.536237 4392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:03.536422 4372 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:03.536549 4372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "c41651e4dead4a0bba6702bb7fedb1f5"
format_stamp: "Formatted at 2026-08-06 00:53:03 on dist-test-slave-44d2"
server_key: "ab24237adc3a1a7c8f74c40de7356220"
server_key_iv: "fc4629fc469ef9a72f1cd4d238f6df81"
server_key_version: "encryptionkey@0"
I20260806 00:53:03.536643 4372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:03.560591 4372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:03.562893 4372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:03.563076 4372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:03.563339 4372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:03.563694 4372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:03.563753 4372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:03.563797 4372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:03.563829 4372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:03.570472 4372 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:37693
I20260806 00:53:03.570524 4549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:37693 every 8 connection(s)
I20260806 00:53:03.570905 4372 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
Aug 06 00:53:03 dist-test-slave-44d2 krb5kdc[4215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977583, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:03.578061 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 4372
I20260806 00:53:03.578176 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:03.578348 3466 external_mini_cluster.cc:1428] Setting key 810e0950f6103056a55eee27cd1f480a
I20260806 00:53:03.581524 4552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.571684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35995 (local address 127.3.98.129:34267)
0806 00:53:03.571868 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:03.571906 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:03.573138 (+ 1232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:03.573437 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:03.573441 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:03.573709 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:03.573908 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:03.573912 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.574647 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.574648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:03.575482 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:03.575484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.575894 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.575895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:03.576027 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.576572 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:03.576581 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:03.578071 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:03.579927 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:03.579935 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:03.579938 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:03.580199 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:03.580417 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:03.580418 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:03.580419 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:03.580596 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:03.580925 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:03.580935 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:03.581130 (+ 195us) client_negotiation.cc:769] Sending connection context
0806 00:53:03.581220 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 00:53:03.581351 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":84,"threads_started":1}
I20260806 00:53:03.581523 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.571707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:34267 (local address 127.3.98.190:35995)
0806 00:53:03.571757 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:03.571759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:03.571999 (+ 240us) server_negotiation.cc:407] Connection header received
0806 00:53:03.573280 (+ 1281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:03.573281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:03.573295 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:03.573342 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:03.574021 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.574544 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.575581 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.575787 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.575878 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.578186 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:03.578187 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:03.578187 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:03.578195 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:03.579829 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:03.580282 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:03.580284 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:03.580284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:03.580348 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:03.580668 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:03.580669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:03.580669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:03.580826 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:03.580907 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:03.581285 (+ 378us) server_negotiation.cc:299] Negotiation successful
0806 00:53:03.581385 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:53:03.582098 4550 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35995
I20260806 00:53:03.582221 4550 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:03.582414 4550 heartbeater.cc:511] Master 127.3.98.190:35995 requested a full tablet report, sending...
I20260806 00:53:03.582906 4281 ts_manager.cc:194] Registered new tserver with Master: c41651e4dead4a0bba6702bb7fedb1f5 (127.3.98.129:37693)
I20260806 00:53:03.583529 4281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:34267
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:53:03.607106 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35995
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:03.693945 4555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:03.694232 4555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:03.694274 4555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:03.695431 4555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:03.695504 4555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:03.695554 4555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:03.697152 4555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35995
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:03.697420 4555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:03.697675 4555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:03.702991 4561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:03.702981 4565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:03.703150 4555 server_base.cc:1034] running on GCE node
W20260806 00:53:03.703249 4562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:03.703496 4555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:03.703739 4555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:03.704896 4555 hybrid_clock.cc:648] HybridClock initialized: now 1785977583704875 us; error 40 us; skew 500 ppm
Aug 06 00:53:03 dist-test-slave-44d2 krb5kdc[4215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977583, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:03.707464 4555 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:53:03.708004 4555 webserver.cc:460] Webserver started at http://127.3.98.130:36697/ using document root <none> and password file <none>
I20260806 00:53:03.708252 4555 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:03.708303 4555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:03.708439 4555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:03.709545 4555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "54174870a7e24c879bd9074774ee2d90"
format_stamp: "Formatted at 2026-08-06 00:53:03 on dist-test-slave-44d2"
server_key: "700a03884e01285207008c7b55da343a"
server_key_iv: "39a33f5baec7d3f72b6168bd297b7347"
server_key_version: "encryptionkey@0"
I20260806 00:53:03.709909 4555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "54174870a7e24c879bd9074774ee2d90"
format_stamp: "Formatted at 2026-08-06 00:53:03 on dist-test-slave-44d2"
server_key: "700a03884e01285207008c7b55da343a"
server_key_iv: "39a33f5baec7d3f72b6168bd297b7347"
server_key_version: "encryptionkey@0"
I20260806 00:53:03.711269 4555 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:53:03.712015 4576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:03.712217 4555 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:03.712313 4555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "54174870a7e24c879bd9074774ee2d90"
format_stamp: "Formatted at 2026-08-06 00:53:03 on dist-test-slave-44d2"
server_key: "700a03884e01285207008c7b55da343a"
server_key_iv: "39a33f5baec7d3f72b6168bd297b7347"
server_key_version: "encryptionkey@0"
I20260806 00:53:03.712386 4555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:03.730067 4555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:03.732039 4555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:03.732213 4555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:03.732463 4555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:03.732878 4555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:03.732961 4555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:03.733006 4555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:03.733034 4555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:03.739400 4555 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:42905
I20260806 00:53:03.739480 4730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:42905 every 8 connection(s)
I20260806 00:53:03.739814 4555 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:03.743234 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 4555
I20260806 00:53:03.743333 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:03.743549 3466 external_mini_cluster.cc:1428] Setting key 5a2029a2642b02782d2aa6517ff01e10
Aug 06 00:53:03 dist-test-slave-44d2 krb5kdc[4215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977583, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:03.751097 4735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.740679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35995 (local address 127.3.98.130:47925)
0806 00:53:03.740895 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:03.740933 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:03.741869 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:03.742127 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:03.742131 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:03.742392 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:03.742591 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:03.742595 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.743442 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.743443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:03.744526 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:03.744530 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.744879 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.744880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:03.745049 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.745559 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:03.745570 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:03.747550 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:03.749547 (+ 1997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:03.749555 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:03.749557 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:03.749825 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:03.750122 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:03.750123 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:03.750123 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:03.750242 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:03.750566 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:03.750571 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:03.750693 (+ 122us) client_negotiation.cc:769] Sending connection context
0806 00:53:03.750782 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 00:53:03.750913 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":130,"threads_started":1}
I20260806 00:53:03.751101 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.740724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:47925 (local address 127.3.98.190:35995)
0806 00:53:03.740820 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:03.740823 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:03.741018 (+ 195us) server_negotiation.cc:407] Connection header received
0806 00:53:03.741999 (+ 981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:03.742001 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:03.742012 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:03.742068 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:03.742671 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.743317 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.744603 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.744791 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.744849 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.747653 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:03.747654 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:03.747655 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:03.747663 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:03.749435 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:03.749917 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:03.749919 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:03.749919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:03.749992 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:03.750320 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:03.750321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:03.750322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:03.750489 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:03.750573 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:03.750836 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 00:53:03.750943 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 00:53:03.751691 4731 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35995
I20260806 00:53:03.751789 4731 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:03.752000 4731 heartbeater.cc:511] Master 127.3.98.190:35995 requested a full tablet report, sending...
I20260806 00:53:03.752473 4281 ts_manager.cc:194] Registered new tserver with Master: 54174870a7e24c879bd9074774ee2d90 (127.3.98.130:42905)
I20260806 00:53:03.752882 4281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:47925
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:53:03.773032 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35995
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:03.857496 4738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:03.857748 4738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:03.857786 4738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:03.858932 4738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:03.859001 4738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:03.859057 4738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:03.860689 4738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35995
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:03.860961 4738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:03.861212 4738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:03.866343 4746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:03.866475 4738 server_base.cc:1034] running on GCE node
W20260806 00:53:03.866343 4743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:03.866611 4744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:03.866817 4738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:03.867015 4738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:03.868202 4738 hybrid_clock.cc:648] HybridClock initialized: now 1785977583868191 us; error 31 us; skew 500 ppm
Aug 06 00:53:03 dist-test-slave-44d2 krb5kdc[4215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977583, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:03.871024 4738 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:53:03.871627 4738 webserver.cc:460] Webserver started at http://127.3.98.131:44861/ using document root <none> and password file <none>
I20260806 00:53:03.871901 4738 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:03.871979 4738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:03.872160 4738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:03.873412 4738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "d00edabb3a4f406685f3102386e2476b"
format_stamp: "Formatted at 2026-08-06 00:53:03 on dist-test-slave-44d2"
server_key: "fce071b4eb5502ee4f66a4cc7b649b45"
server_key_iv: "6677978df19134885956f67ccd06d9fb"
server_key_version: "encryptionkey@0"
I20260806 00:53:03.873835 4738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "d00edabb3a4f406685f3102386e2476b"
format_stamp: "Formatted at 2026-08-06 00:53:03 on dist-test-slave-44d2"
server_key: "fce071b4eb5502ee4f66a4cc7b649b45"
server_key_iv: "6677978df19134885956f67ccd06d9fb"
server_key_version: "encryptionkey@0"
I20260806 00:53:03.875489 4738 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 00:53:03.876338 4759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:03.876569 4738 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:03.876686 4738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "d00edabb3a4f406685f3102386e2476b"
format_stamp: "Formatted at 2026-08-06 00:53:03 on dist-test-slave-44d2"
server_key: "fce071b4eb5502ee4f66a4cc7b649b45"
server_key_iv: "6677978df19134885956f67ccd06d9fb"
server_key_version: "encryptionkey@0"
I20260806 00:53:03.876781 4738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:03.886620 4738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:03.888911 4738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:03.889104 4738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:03.889356 4738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:03.889710 4738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:03.889772 4738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:03.889819 4738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:03.889847 4738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:03.897167 4738 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:35639
I20260806 00:53:03.897224 4924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:35639 every 8 connection(s)
I20260806 00:53:03.897576 4738 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:03.898296 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 4738
I20260806 00:53:03.898408 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:03.898603 3466 external_mini_cluster.cc:1428] Setting key d6ca5b9ec17f28c4654c8ee6514eb16f
Aug 06 00:53:03 dist-test-slave-44d2 krb5kdc[4215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977583, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:03.908238 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.898343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:35459 (local address 127.3.98.190:35995)
0806 00:53:03.898414 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:03.898417 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:03.898632 (+ 215us) server_negotiation.cc:407] Connection header received
0806 00:53:03.899908 (+ 1276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:03.899909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:03.899923 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:03.899996 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:03.900796 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.901397 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.902537 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.902777 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.902875 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.905278 (+ 2403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:03.905281 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:03.905281 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:03.905290 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:03.906696 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:03.907153 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:03.907154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:03.907155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:03.907228 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:03.907511 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:03.907512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:03.907513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:03.907645 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:03.907729 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:03.908041 (+ 312us) server_negotiation.cc:299] Negotiation successful
0806 00:53:03.908134 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 00:53:03.908442 4929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.898317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35995 (local address 127.3.98.131:35459)
0806 00:53:03.898503 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:03.898541 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:03.899779 (+ 1238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:03.900076 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:03.900080 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:03.900371 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:03.900692 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:03.900698 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.901511 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.901512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:03.902409 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:03.902411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.902893 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.902894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:03.903029 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.903534 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:03.903543 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:03.905166 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:03.906780 (+ 1614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:03.906789 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:03.906791 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:03.907052 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:03.907307 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:03.907307 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:03.907308 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:03.907426 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:03.907719 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:03.907727 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:03.907879 (+ 152us) client_negotiation.cc:769] Sending connection context
0806 00:53:03.908002 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 00:53:03.908179 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":97,"threads_started":1}
I20260806 00:53:03.908978 4927 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35995
I20260806 00:53:03.909086 4927 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:03.909235 4927 heartbeater.cc:511] Master 127.3.98.190:35995 requested a full tablet report, sending...
I20260806 00:53:03.909662 4281 ts_manager.cc:194] Registered new tserver with Master: d00edabb3a4f406685f3102386e2476b (127.3.98.131:35639)
I20260806 00:53:03.910250 4281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:35459
I20260806 00:53:03.910621 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:53:03.919055 4342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.912682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48676 (local address 127.3.98.190:35995)
0806 00:53:03.912725 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:03.912727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:03.912828 (+ 101us) server_negotiation.cc:407] Connection header received
0806 00:53:03.912866 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:03.912867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:03.912876 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:03.912953 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:03.913500 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.914056 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.914775 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.914990 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.915049 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.916536 (+ 1487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:03.916537 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:03.916538 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:03.916546 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:03.917859 (+ 1313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:03.918296 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:03.918297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:03.918297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:03.918350 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:03.918561 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:03.918562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:03.918562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:03.918716 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:03.918793 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:03.918896 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 00:53:03.918958 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 00:53:03.922266 4281 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48676:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:03.924211 4281 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:03.931511 4941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.927472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:37693 (local address 127.0.0.1:36764)
0806 00:53:03.927686 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:03.927731 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:03.927803 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:03.928019 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:03.928022 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:03.928025 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:03.928112 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:03.928114 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.929318 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.929319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:03.930237 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:03.930239 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.931188 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.931189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:03.931280 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.931297 (+ 17us) client_negotiation.cc:769] Sending connection context
0806 00:53:03.931372 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 00:53:03.931423 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":84,"threads_started":1}
I20260806 00:53:03.931525 4943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.927632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36764 (local address 127.3.98.129:37693)
0806 00:53:03.927839 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:03.927845 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:03.927858 (+ 13us) server_negotiation.cc:407] Connection header received
0806 00:53:03.927909 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:03.927911 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:03.927923 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:03.928016 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:03.928207 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.929223 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.930356 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.931100 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.931180 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.931250 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:03.931400 (+ 150us) server_negotiation.cc:299] Negotiation successful
0806 00:53:03.931443 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":83,"threads_started":1}
I20260806 00:53:03.932178 4945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.927525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:35639 (local address 127.0.0.1:49620)
0806 00:53:03.928135 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:03.928145 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:03.928189 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:03.928810 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:03.928811 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:03.928814 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:03.928865 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:03.928866 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.930104 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.930105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:03.930971 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:03.930974 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.931918 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.931919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:03.931984 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.931989 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:53:03.932067 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 00:53:03.932107 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":87,"threads_started":1}
I20260806 00:53:03.932193 4944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.927641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49620 (local address 127.3.98.131:35639)
0806 00:53:03.928518 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:03.928523 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:03.928533 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:03.928570 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:03.928572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:03.928588 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:03.928808 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:03.928942 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.929992 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.931063 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.931820 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.931905 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.931974 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:03.932083 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 00:53:03.932121 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":782,"thread_start_us":103,"threads_started":1}
I20260806 00:53:03.932403 4942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.927707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:42905 (local address 127.0.0.1:46384)
0806 00:53:03.928259 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:03.928272 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:03.928335 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:03.928537 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:03.928538 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:03.928541 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:03.928596 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:03.928597 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.930047 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.930048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:03.931143 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:03.931146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.932160 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.932161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:03.932240 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.932244 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:03.932297 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 00:53:03.932336 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"mutex_wait_us":3,"thread_start_us":66,"threads_started":1}
I20260806 00:53:03.932698 4946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:03.927909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46384 (local address 127.3.98.130:42905)
0806 00:53:03.928118 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:03.928121 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:03.928343 (+ 222us) server_negotiation.cc:407] Connection header received
0806 00:53:03.928408 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:03.928411 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:03.928426 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:03.928729 (+ 303us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:03.928834 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.929919 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.931235 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:03.932000 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:03.932066 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:03.932122 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:03.932564 (+ 442us) server_negotiation.cc:299] Negotiation successful
0806 00:53:03.932618 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":83,"threads_started":1}
I20260806 00:53:03.932713 4459 tablet_service.cc:1467] Processing CreateTablet for tablet effb5f26722e4aa1826cbbdc05bf0899 (DEFAULT_TABLE table=test-table [id=82ea5d11b8b847f79c8fc1cfbc26159c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:03.933109 4459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet effb5f26722e4aa1826cbbdc05bf0899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:03.933102 4831 tablet_service.cc:1467] Processing CreateTablet for tablet effb5f26722e4aa1826cbbdc05bf0899 (DEFAULT_TABLE table=test-table [id=82ea5d11b8b847f79c8fc1cfbc26159c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:03.933416 4831 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet effb5f26722e4aa1826cbbdc05bf0899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:03.936261 4947 tablet_bootstrap.cc:492] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5: Bootstrap starting.
I20260806 00:53:03.937148 4947 tablet_bootstrap.cc:654] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:03.937677 4646 tablet_service.cc:1467] Processing CreateTablet for tablet effb5f26722e4aa1826cbbdc05bf0899 (DEFAULT_TABLE table=test-table [id=82ea5d11b8b847f79c8fc1cfbc26159c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:03.938050 4947 log.cc:824] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:03.938122 4646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet effb5f26722e4aa1826cbbdc05bf0899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:03.938148 4948 tablet_bootstrap.cc:492] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b: Bootstrap starting.
I20260806 00:53:03.938849 4948 tablet_bootstrap.cc:654] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:03.939030 4947 tablet_bootstrap.cc:492] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5: No bootstrap required, opened a new log
I20260806 00:53:03.939114 4947 ts_tablet_manager.cc:1397] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 00:53:03.939615 4948 log.cc:824] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:03.940398 4948 tablet_bootstrap.cc:492] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b: No bootstrap required, opened a new log
I20260806 00:53:03.940480 4948 ts_tablet_manager.cc:1397] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:53:03.941625 4947 raft_consensus.cc:348] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41651e4dead4a0bba6702bb7fedb1f5" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37693 } } peers { permanent_uuid: "d00edabb3a4f406685f3102386e2476b" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 35639 } } peers { permanent_uuid: "54174870a7e24c879bd9074774ee2d90" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42905 } }
I20260806 00:53:03.941886 4947 raft_consensus.cc:374] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:03.941959 4947 raft_consensus.cc:729] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41651e4dead4a0bba6702bb7fedb1f5, State: Initialized, Role: FOLLOWER
I20260806 00:53:03.941839 4952 tablet_bootstrap.cc:492] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90: Bootstrap starting.
I20260806 00:53:03.941957 4948 raft_consensus.cc:348] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41651e4dead4a0bba6702bb7fedb1f5" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37693 } } peers { permanent_uuid: "d00edabb3a4f406685f3102386e2476b" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 35639 } } peers { permanent_uuid: "54174870a7e24c879bd9074774ee2d90" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42905 } }
I20260806 00:53:03.942128 4948 raft_consensus.cc:374] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:03.942168 4948 raft_consensus.cc:729] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d00edabb3a4f406685f3102386e2476b, State: Initialized, Role: FOLLOWER
I20260806 00:53:03.942123 4947 consensus_queue.cc:260] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41651e4dead4a0bba6702bb7fedb1f5" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37693 } } peers { permanent_uuid: "d00edabb3a4f406685f3102386e2476b" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 35639 } } peers { permanent_uuid: "54174870a7e24c879bd9074774ee2d90" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42905 } }
I20260806 00:53:03.942293 4948 consensus_queue.cc:260] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41651e4dead4a0bba6702bb7fedb1f5" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37693 } } peers { permanent_uuid: "d00edabb3a4f406685f3102386e2476b" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 35639 } } peers { permanent_uuid: "54174870a7e24c879bd9074774ee2d90" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42905 } }
I20260806 00:53:03.942471 4947 ts_tablet_manager.cc:1428] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:53:03.942606 4948 ts_tablet_manager.cc:1428] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 00:53:03.942641 4550 heartbeater.cc:503] Master 127.3.98.190:35995 was elected leader, sending a full tablet report...
I20260806 00:53:03.942675 4952 tablet_bootstrap.cc:654] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:03.942701 4927 heartbeater.cc:503] Master 127.3.98.190:35995 was elected leader, sending a full tablet report...
I20260806 00:53:03.943210 4952 log.cc:824] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:03.944048 4952 tablet_bootstrap.cc:492] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90: No bootstrap required, opened a new log
I20260806 00:53:03.944130 4952 ts_tablet_manager.cc:1397] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:53:03.946194 4952 raft_consensus.cc:348] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41651e4dead4a0bba6702bb7fedb1f5" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37693 } } peers { permanent_uuid: "d00edabb3a4f406685f3102386e2476b" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 35639 } } peers { permanent_uuid: "54174870a7e24c879bd9074774ee2d90" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42905 } }
I20260806 00:53:03.946350 4952 raft_consensus.cc:374] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:03.946390 4952 raft_consensus.cc:729] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54174870a7e24c879bd9074774ee2d90, State: Initialized, Role: FOLLOWER
I20260806 00:53:03.946518 4952 consensus_queue.cc:260] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41651e4dead4a0bba6702bb7fedb1f5" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37693 } } peers { permanent_uuid: "d00edabb3a4f406685f3102386e2476b" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 35639 } } peers { permanent_uuid: "54174870a7e24c879bd9074774ee2d90" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42905 } }
I20260806 00:53:03.946781 4952 ts_tablet_manager.cc:1428] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:53:03.946835 4731 heartbeater.cc:503] Master 127.3.98.190:35995 was elected leader, sending a full tablet report...
W20260806 00:53:03.990465 4734 tablet.cc:2369] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 00:53:04.071695 4551 tablet.cc:2369] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:53:04.082156 4956 raft_consensus.cc:482] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:04.082300 4956 raft_consensus.cc:504] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41651e4dead4a0bba6702bb7fedb1f5" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37693 } } peers { permanent_uuid: "d00edabb3a4f406685f3102386e2476b" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 35639 } } peers { permanent_uuid: "54174870a7e24c879bd9074774ee2d90" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42905 } }
I20260806 00:53:04.082888 4956 leader_election.cc:288] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c41651e4dead4a0bba6702bb7fedb1f5 (127.3.98.129:37693), d00edabb3a4f406685f3102386e2476b (127.3.98.131:35639)
I20260806 00:53:04.086045 4944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:04.083266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:38495 (local address 127.3.98.131:35639)
0806 00:53:04.083315 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:04.083317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:04.083327 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:04.083360 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:04.083361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:04.083374 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:04.083449 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:04.083664 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.084198 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.085257 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.085660 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.085719 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:04.085751 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:04.085919 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 00:53:04.085970 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 00:53:04.086050 4943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:04.083218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:56365 (local address 127.3.98.129:37693)
0806 00:53:04.083280 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:04.083282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:04.083455 (+ 173us) server_negotiation.cc:407] Connection header received
0806 00:53:04.083537 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:04.083539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:04.083553 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:04.083619 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:04.083799 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.084282 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.085318 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.085664 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.085761 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:04.085770 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:04.085948 (+ 178us) server_negotiation.cc:299] Negotiation successful
0806 00:53:04.085987 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 00:53:04.086047 4735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:04.083122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:35639 (local address 127.3.98.130:38495)
0806 00:53:04.083191 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:04.083231 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:04.083284 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:04.083476 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:04.083477 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:04.083479 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:04.083562 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:04.083564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.084285 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.084287 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:04.085160 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:04.085163 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.085753 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.085754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:04.085834 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:04.085837 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:04.085888 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 00:53:04.085956 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":1}
I20260806 00:53:04.086066 4957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:04.083126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:37693 (local address 127.3.98.130:56365)
0806 00:53:04.083373 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:04.083384 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:04.083442 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:04.083648 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:04.083649 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:04.083651 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:04.083726 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:04.083728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.084369 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.084370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:04.085191 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:04.085194 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.085781 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.085782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:04.085851 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:04.085855 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:04.085929 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 00:53:04.085970 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":58,"thread_start_us":111,"threads_started":1}
I20260806 00:53:04.086638 4861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "effb5f26722e4aa1826cbbdc05bf0899" candidate_uuid: "54174870a7e24c879bd9074774ee2d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00edabb3a4f406685f3102386e2476b" is_pre_election: true
I20260806 00:53:04.086753 4488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "effb5f26722e4aa1826cbbdc05bf0899" candidate_uuid: "54174870a7e24c879bd9074774ee2d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41651e4dead4a0bba6702bb7fedb1f5" is_pre_election: true
I20260806 00:53:04.086867 4861 raft_consensus.cc:2454] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54174870a7e24c879bd9074774ee2d90 in term 0.
I20260806 00:53:04.086935 4488 raft_consensus.cc:2454] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54174870a7e24c879bd9074774ee2d90 in term 0.
I20260806 00:53:04.087213 4577 leader_election.cc:302] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54174870a7e24c879bd9074774ee2d90, c41651e4dead4a0bba6702bb7fedb1f5; no voters:
I20260806 00:53:04.087427 4956 raft_consensus.cc:2781] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:04.087524 4956 raft_consensus.cc:482] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:04.087556 4956 raft_consensus.cc:3037] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:04.088346 4956 raft_consensus.cc:504] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41651e4dead4a0bba6702bb7fedb1f5" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37693 } } peers { permanent_uuid: "d00edabb3a4f406685f3102386e2476b" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 35639 } } peers { permanent_uuid: "54174870a7e24c879bd9074774ee2d90" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42905 } }
I20260806 00:53:04.088560 4956 leader_election.cc:288] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [CANDIDATE]: Term 1 election: Requested vote from peers c41651e4dead4a0bba6702bb7fedb1f5 (127.3.98.129:37693), d00edabb3a4f406685f3102386e2476b (127.3.98.131:35639)
I20260806 00:53:04.088735 4861 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "effb5f26722e4aa1826cbbdc05bf0899" candidate_uuid: "54174870a7e24c879bd9074774ee2d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d00edabb3a4f406685f3102386e2476b"
I20260806 00:53:04.088742 4488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "effb5f26722e4aa1826cbbdc05bf0899" candidate_uuid: "54174870a7e24c879bd9074774ee2d90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41651e4dead4a0bba6702bb7fedb1f5"
I20260806 00:53:04.088824 4861 raft_consensus.cc:3037] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:04.088852 4488 raft_consensus.cc:3037] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:04.089591 4861 raft_consensus.cc:2454] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54174870a7e24c879bd9074774ee2d90 in term 1.
I20260806 00:53:04.089774 4580 leader_election.cc:302] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54174870a7e24c879bd9074774ee2d90, d00edabb3a4f406685f3102386e2476b; no voters:
I20260806 00:53:04.089811 4488 raft_consensus.cc:2454] T effb5f26722e4aa1826cbbdc05bf0899 P c41651e4dead4a0bba6702bb7fedb1f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54174870a7e24c879bd9074774ee2d90 in term 1.
I20260806 00:53:04.089875 4956 raft_consensus.cc:2781] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:04.090102 4956 raft_consensus.cc:686] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [term 1 LEADER]: Becoming Leader. State: Replica: 54174870a7e24c879bd9074774ee2d90, State: Running, Role: LEADER
I20260806 00:53:04.090224 4956 consensus_queue.cc:237] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41651e4dead4a0bba6702bb7fedb1f5" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37693 } } peers { permanent_uuid: "d00edabb3a4f406685f3102386e2476b" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 35639 } } peers { permanent_uuid: "54174870a7e24c879bd9074774ee2d90" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42905 } }
I20260806 00:53:04.091262 4279 catalog_manager.cc:5495] T effb5f26722e4aa1826cbbdc05bf0899 P 54174870a7e24c879bd9074774ee2d90 reported cstate change: term changed from 0 to 1, leader changed from <none> to 54174870a7e24c879bd9074774ee2d90 (127.3.98.130). New cstate: current_term: 1 leader_uuid: "54174870a7e24c879bd9074774ee2d90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c41651e4dead4a0bba6702bb7fedb1f5" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d00edabb3a4f406685f3102386e2476b" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 35639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54174870a7e24c879bd9074774ee2d90" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42905 } health_report { overall_health: HEALTHY } } }
Aug 06 00:53:04 dist-test-slave-44d2 krb5kdc[4215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.129@KRBTEST.COM
I20260806 00:53:04.120033 4943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:04.111688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36772 (local address 127.3.98.129:37693)
0806 00:53:04.111775 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:04.111777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:04.111879 (+ 102us) server_negotiation.cc:407] Connection header received
0806 00:53:04.111965 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:04.111966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:04.111984 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:04.112061 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:04.112788 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.113276 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.114017 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.114217 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.114296 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:04.117128 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:04.117142 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:04.117143 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:04.117150 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:04.118910 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:04.119272 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:04.119275 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:04.119275 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:04.119345 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:04.119550 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:04.119550 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:04.119551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:04.119696 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:04.119804 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:04.119894 (+ 90us) server_negotiation.cc:299] Negotiation successful
0806 00:53:04.119963 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 00:53:04 dist-test-slave-44d2 krb5kdc[4215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977584, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 00:53:04 dist-test-slave-44d2 krb5kdc[4215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977584, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.98.129@KRBTEST.COM
I20260806 00:53:04.145079 4943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:04.137774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36788 (local address 127.3.98.129:37693)
0806 00:53:04.137864 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:04.137866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:04.137907 (+ 41us) server_negotiation.cc:407] Connection header received
0806 00:53:04.137968 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:04.137969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:04.137982 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:04.138038 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:04.138580 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.139081 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.139925 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.140137 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.140196 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:04.142515 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:04.142517 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:04.142517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:04.142524 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:04.143961 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:04.144269 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:04.144270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:04.144270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:04.144320 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:04.144548 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:04.144549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:04.144549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:04.144648 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:04.144722 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:04.144879 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 00:53:04.144942 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260806 00:53:04.148216 4928 tablet.cc:2369] T effb5f26722e4aa1826cbbdc05bf0899 P d00edabb3a4f406685f3102386e2476b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 00:53:04 dist-test-slave-44d2 krb5kdc[4215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 00:53:04 dist-test-slave-44d2 krb5kdc[4215](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.129@KRBTEST.COM
I20260806 00:53:04.171082 4943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:04.162960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36804 (local address 127.3.98.129:37693)
0806 00:53:04.163047 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:04.163049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:04.163174 (+ 125us) server_negotiation.cc:407] Connection header received
0806 00:53:04.163272 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:04.163273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:04.163284 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:04.163349 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:04.163955 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.164574 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.165422 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:04.165662 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:04.165725 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:04.168337 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:04.168339 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:04.168339 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:04.168346 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:04.169781 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:04.170149 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:04.170151 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:04.170151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:04.170219 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:04.170433 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:04.170435 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:04.170435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:04.170558 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:04.170680 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:04.170768 (+ 88us) server_negotiation.cc:299] Negotiation successful
0806 00:53:04.170958 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260806 00:53:04.171903 4431 tablet_service.cc:2908] Rejecting scan request for tablet effb5f26722e4aa1826cbbdc05bf0899: Uninitialized: clean time has not yet been initialized
I20260806 00:53:04.173074 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 4372
I20260806 00:53:04.186657 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 4555
I20260806 00:53:04.202764 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 4738
I20260806 00:53:04.211833 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 4236
2026-08-06T00:53:04Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2436 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:04 dist-test-slave-44d2 krb5kdc[4979](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:04 dist-test-slave-44d2 krb5kdc[4979](info): set up 2 sockets
Aug 06 00:53:04 dist-test-slave-44d2 krb5kdc[4979](info): commencing operation
krb5kdc: starting...
W20260806 00:53:05.502094 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:05 dist-test-slave-44d2 krb5kdc[4979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:53:05.631129 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:42695
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:36823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:42695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:05.717710 4992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:05.717957 4992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:05.717983 4992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:05.719153 4992 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:05.719192 4992 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 00:53:05.719205 4992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:05.719219 4992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:05.719233 4992 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:05.719245 4992 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:05.720754 4992 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:42695
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:42695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:05.720966 4992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:05.721155 4992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 00:53:05.726468 4992 server_base.cc:1034] running on GCE node
W20260806 00:53:05.726434 5003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:05.726424 5006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:05.726444 5004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:05.726925 4992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:05.727249 4992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:05.728428 4992 hybrid_clock.cc:648] HybridClock initialized: now 1785977585728408 us; error 52 us; skew 500 ppm
Aug 06 00:53:05 dist-test-slave-44d2 krb5kdc[4979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977585, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:05.731118 4992 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:53:05.731634 4992 webserver.cc:460] Webserver started at http://127.3.98.190:40457/ using document root <none> and password file <none>
I20260806 00:53:05.731874 4992 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:05.731948 4992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:05.732113 4992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:05.733309 4992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "328e37b04e8a441587f25332e9c5cde3"
format_stamp: "Formatted at 2026-08-06 00:53:05 on dist-test-slave-44d2"
server_key: "c6e27f694e75bb7a1ff53fc1ecb37c89"
server_key_iv: "de31db3c84716cac682aa34a08a9b060"
server_key_version: "encryptionkey@0"
I20260806 00:53:05.733693 4992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "328e37b04e8a441587f25332e9c5cde3"
format_stamp: "Formatted at 2026-08-06 00:53:05 on dist-test-slave-44d2"
server_key: "c6e27f694e75bb7a1ff53fc1ecb37c89"
server_key_iv: "de31db3c84716cac682aa34a08a9b060"
server_key_version: "encryptionkey@0"
I20260806 00:53:05.735049 4992 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:53:05.735806 5016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:05.735992 4992 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:05.736116 4992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "328e37b04e8a441587f25332e9c5cde3"
format_stamp: "Formatted at 2026-08-06 00:53:05 on dist-test-slave-44d2"
server_key: "c6e27f694e75bb7a1ff53fc1ecb37c89"
server_key_iv: "de31db3c84716cac682aa34a08a9b060"
server_key_version: "encryptionkey@0"
I20260806 00:53:05.736194 4992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:05.749955 4992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:05.752339 4992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:05.752527 4992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:05.758477 4992 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:42695
I20260806 00:53:05.758523 5104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:42695 every 8 connection(s)
I20260806 00:53:05.758919 4992 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:05.759580 5105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:05.762087 5105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3: Bootstrap starting.
I20260806 00:53:05.762773 5105 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:05.763094 5105 log.cc:824] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:05.763799 5105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3: No bootstrap required, opened a new log
I20260806 00:53:05.766202 5105 raft_consensus.cc:348] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "328e37b04e8a441587f25332e9c5cde3" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42695 } }
I20260806 00:53:05.766388 5105 raft_consensus.cc:374] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:05.766469 5105 raft_consensus.cc:729] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 328e37b04e8a441587f25332e9c5cde3, State: Initialized, Role: FOLLOWER
I20260806 00:53:05.766623 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 4992
I20260806 00:53:05.766640 5105 consensus_queue.cc:260] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "328e37b04e8a441587f25332e9c5cde3" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42695 } }
I20260806 00:53:05.766724 5105 raft_consensus.cc:388] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:05.766742 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:05.766767 5105 raft_consensus.cc:482] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:05.766816 5105 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:05.766913 3466 external_mini_cluster.cc:1428] Setting key ecc85543645f915035df15ebc69956a3
I20260806 00:53:05.767452 5105 raft_consensus.cc:504] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "328e37b04e8a441587f25332e9c5cde3" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42695 } }
I20260806 00:53:05.767573 5105 leader_election.cc:302] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 328e37b04e8a441587f25332e9c5cde3; no voters:
I20260806 00:53:05.767728 5105 leader_election.cc:288] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:05.767765 5112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:05.767961 5112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [term 1 LEADER]: Becoming Leader. State: Replica: 328e37b04e8a441587f25332e9c5cde3, State: Running, Role: LEADER
I20260806 00:53:05.768034 5105 sys_catalog.cc:564] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:05.768131 5112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "328e37b04e8a441587f25332e9c5cde3" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42695 } }
I20260806 00:53:05.768638 5112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 328e37b04e8a441587f25332e9c5cde3. Latest consensus state: current_term: 1 leader_uuid: "328e37b04e8a441587f25332e9c5cde3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "328e37b04e8a441587f25332e9c5cde3" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42695 } } }
I20260806 00:53:05.768728 5112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:05.768836 5114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "328e37b04e8a441587f25332e9c5cde3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "328e37b04e8a441587f25332e9c5cde3" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42695 } } }
I20260806 00:53:05.768996 5114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:05.769085 5122 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:05.769608 5122 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:05.771313 5122 catalog_manager.cc:1347] Generated new cluster ID: 11ec42cc27bc4291a3b16095002c16b8
I20260806 00:53:05.771366 5122 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:53:05 dist-test-slave-44d2 krb5kdc[4979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977585, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:05.779201 5111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:05.767463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44636 (local address 127.3.98.190:42695)
0806 00:53:05.767669 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:05.767679 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:05.767715 (+ 36us) server_negotiation.cc:407] Connection header received
0806 00:53:05.767839 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:05.767847 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:05.767909 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:05.768995 (+ 1086us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:05.769141 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:05.770664 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:05.771657 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:05.772247 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:05.772339 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:05.775332 (+ 2993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:05.775336 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:05.775336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:05.775348 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:05.777401 (+ 2053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:05.777840 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:05.777843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:05.777843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:05.777961 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:05.778191 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:05.778191 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:05.778192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:05.778476 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:05.778623 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:05.778746 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 00:53:05.778975 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":91,"threads_started":1}
I20260806 00:53:05.781090 5122 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:05.781845 5122 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:05.786675 5122 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3: Generated new TSK 0
I20260806 00:53:05.786847 5122 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:53:05.819707 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42695
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:36823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:05.905468 5139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:05.905675 5139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:05.905699 5139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:05.906868 5139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:05.906913 5139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:05.906939 5139 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 00:53:05.906958 5139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:05.908391 5139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.98.190:42695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5139
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:05.908658 5139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:05.908857 5139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:05.914194 5145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:05.914361 5148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:05.914206 5146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:05.914436 5139 server_base.cc:1034] running on GCE node
I20260806 00:53:05.914683 5139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:05.914944 5139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:05.916121 5139 hybrid_clock.cc:648] HybridClock initialized: now 1785977585916101 us; error 39 us; skew 500 ppm
Aug 06 00:53:05 dist-test-slave-44d2 krb5kdc[4979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977585, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:05.922590 5139 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:53:05.923060 5139 webserver.cc:460] Webserver started at http://127.3.98.129:37287/ using document root <none> and password file <none>
I20260806 00:53:05.923281 5139 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:05.923326 5139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:05.923422 5139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:05.924562 5139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "0ecf1fbe91414bf191fa76e717e53db8"
format_stamp: "Formatted at 2026-08-06 00:53:05 on dist-test-slave-44d2"
server_key: "dee50485062a0eb9a981df7756411ebe"
server_key_iv: "dba29159bee2769590a403e85f9b717c"
server_key_version: "encryptionkey@0"
I20260806 00:53:05.924916 5139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "0ecf1fbe91414bf191fa76e717e53db8"
format_stamp: "Formatted at 2026-08-06 00:53:05 on dist-test-slave-44d2"
server_key: "dee50485062a0eb9a981df7756411ebe"
server_key_iv: "dba29159bee2769590a403e85f9b717c"
server_key_version: "encryptionkey@0"
I20260806 00:53:05.926236 5139 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:05.926990 5156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:05.927188 5139 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:05.927285 5139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "0ecf1fbe91414bf191fa76e717e53db8"
format_stamp: "Formatted at 2026-08-06 00:53:05 on dist-test-slave-44d2"
server_key: "dee50485062a0eb9a981df7756411ebe"
server_key_iv: "dba29159bee2769590a403e85f9b717c"
server_key_version: "encryptionkey@0"
I20260806 00:53:05.927363 5139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:05.934857 5139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:05.937328 5139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:05.937487 5139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:05.937975 5139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:05.938011 5139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:05.938056 5139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:05.938086 5139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:05.945832 5139 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:38677
Aug 06 00:53:05 dist-test-slave-44d2 krb5kdc[4979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977585, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:05.945922 5320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:38677 every 8 connection(s)
I20260806 00:53:05.946233 5139 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:53:05.949836 5111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:05.938693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:41365 (local address 127.3.98.190:42695)
0806 00:53:05.938748 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:05.938750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:05.939006 (+ 256us) server_negotiation.cc:407] Connection header received
0806 00:53:05.939531 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:05.939533 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:05.939546 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:05.939615 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:05.940582 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:05.941470 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:05.943201 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:05.943541 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:05.943634 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:05.946425 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:05.946427 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:05.946427 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:05.946439 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:05.948083 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:05.948656 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:05.948657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:05.948658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:05.948745 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:05.949107 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:05.949108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:05.949109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:05.949277 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:05.949351 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:05.949652 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 00:53:05.949744 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:53:05.950011 5175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:05.938666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:42695 (local address 127.3.98.129:41365)
0806 00:53:05.938860 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:05.938896 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:05.939417 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:05.939687 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:05.939690 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:05.940148 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:05.940451 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:05.940457 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:05.941587 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:05.941589 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:05.943093 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:05.943097 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:05.943651 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:05.943652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:05.943810 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:05.944414 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:05.944424 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:05.946338 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:05.948184 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:05.948192 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:05.948194 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:05.948551 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:05.948833 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:05.948834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:05.948835 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:05.949025 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:05.949355 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:05.949363 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:05.949503 (+ 140us) client_negotiation.cc:769] Sending connection context
0806 00:53:05.949612 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 00:53:05.949773 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":100,"threads_started":1}
I20260806 00:53:05.950588 5321 heartbeater.cc:347] Connected to a master server at 127.3.98.190:42695
I20260806 00:53:05.950691 5321 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:05.950901 5321 heartbeater.cc:511] Master 127.3.98.190:42695 requested a full tablet report, sending...
I20260806 00:53:05.951449 5041 ts_manager.cc:194] Registered new tserver with Master: 0ecf1fbe91414bf191fa76e717e53db8 (127.3.98.129:38677)
I20260806 00:53:05.952512 5041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:41365
I20260806 00:53:05.955924 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 5139
I20260806 00:53:05.956050 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:05.956272 3466 external_mini_cluster.cc:1428] Setting key f4cf2eaf2c00249383abf55d7c6b3494
I20260806 00:53:05.957928 5327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:05.951718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:42695 (local address 127.3.98.129:52767)
0806 00:53:05.951870 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:05.951883 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:05.951955 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:05.952079 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:05.952080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:05.952299 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:05.952378 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:05.952379 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:05.953275 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:05.953277 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:05.953839 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:05.953842 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:05.954174 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:05.954175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:05.954244 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:05.954652 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:05.954657 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:05.954984 (+ 327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:05.956796 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:05.956797 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:05.956798 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:05.956978 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:05.957223 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:05.957224 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:05.957225 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:05.957293 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:05.957560 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:05.957561 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:05.957614 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 00:53:05.957705 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 00:53:05.957825 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
I20260806 00:53:05.957922 5111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:05.951819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:52767 (local address 127.3.98.190:42695)
0806 00:53:05.951862 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:05.951864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:05.951942 (+ 78us) server_negotiation.cc:407] Connection header received
0806 00:53:05.952018 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:05.952019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:05.952026 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:05.952071 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:05.952451 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:05.953168 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:05.953919 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:05.954103 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:05.954155 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:05.955068 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:05.955070 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:05.955070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:05.955077 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:05.956704 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:05.957055 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:05.957056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:05.957057 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:05.957117 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:05.957372 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:05.957373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:05.957373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:05.957491 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:05.957578 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:05.957734 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 00:53:05.957824 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:53:05.986951 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42695
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:36823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:06.072088 5332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:06.072288 5332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:06.072311 5332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:06.073503 5332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:06.073546 5332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:06.073568 5332 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 00:53:06.073585 5332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:06.074962 5332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.98.190:42695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:06.075167 5332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:06.075353 5332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:06.080734 5338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:06.080773 5341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:06.080768 5339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:06.081218 5332 server_base.cc:1034] running on GCE node
I20260806 00:53:06.081450 5332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:06.081710 5332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:06.082865 5332 hybrid_clock.cc:648] HybridClock initialized: now 1785977586082845 us; error 35 us; skew 500 ppm
Aug 06 00:53:06 dist-test-slave-44d2 krb5kdc[4979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977586, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:06.090219 5332 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:53:06.090730 5332 webserver.cc:460] Webserver started at http://127.3.98.130:38229/ using document root <none> and password file <none>
I20260806 00:53:06.090997 5332 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:06.091046 5332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:06.091251 5332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:06.092669 5332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "7918934dde8143d2b8eff270ea63f0e1"
format_stamp: "Formatted at 2026-08-06 00:53:06 on dist-test-slave-44d2"
server_key: "16e0619fb9804fbbc807950fa4006cde"
server_key_iv: "035297d96b2f3001fc036d00a511b4b7"
server_key_version: "encryptionkey@0"
I20260806 00:53:06.093158 5332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "7918934dde8143d2b8eff270ea63f0e1"
format_stamp: "Formatted at 2026-08-06 00:53:06 on dist-test-slave-44d2"
server_key: "16e0619fb9804fbbc807950fa4006cde"
server_key_iv: "035297d96b2f3001fc036d00a511b4b7"
server_key_version: "encryptionkey@0"
I20260806 00:53:06.095592 5332 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 00:53:06.096697 5351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:06.096927 5332 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:06.097028 5332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "7918934dde8143d2b8eff270ea63f0e1"
format_stamp: "Formatted at 2026-08-06 00:53:06 on dist-test-slave-44d2"
server_key: "16e0619fb9804fbbc807950fa4006cde"
server_key_iv: "035297d96b2f3001fc036d00a511b4b7"
server_key_version: "encryptionkey@0"
I20260806 00:53:06.097126 5332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:06.131763 5332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:06.134716 5332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:06.134888 5332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:06.135658 5332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:06.135720 5332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:06.135767 5332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:06.135799 5332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 00:53:06 dist-test-slave-44d2 krb5kdc[4979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977586, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:06.144611 5332 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:38801
I20260806 00:53:06.144670 5517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:38801 every 8 connection(s)
I20260806 00:53:06.145064 5332 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:06.147848 5111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.135983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:37865 (local address 127.3.98.190:42695)
0806 00:53:06.136032 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.136035 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.136297 (+ 262us) server_negotiation.cc:407] Connection header received
0806 00:53:06.137007 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.137009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.137023 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.137075 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:06.137948 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.138777 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.140417 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.140774 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.140858 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.144529 (+ 3671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:06.144531 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:06.144531 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:06.144539 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:06.146315 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.146842 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.146843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.146843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.146892 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.147168 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.147169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.147169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.147297 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:06.147371 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.147666 (+ 295us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.147757 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:53:06.148018 5364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.135989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:42695 (local address 127.3.98.130:37865)
0806 00:53:06.136177 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.136218 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.136896 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.137161 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.137165 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.137519 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:06.137858 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.137865 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.138927 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.138929 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.140311 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.140314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.140931 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.140932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.141084 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.141609 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:06.141620 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:06.144376 (+ 2756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:06.146383 (+ 2007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:06.146389 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:06.146391 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:06.146749 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:06.146970 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:06.146972 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:06.146972 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:06.147094 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:06.147374 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:06.147381 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:06.147524 (+ 143us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.147626 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.147786 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":90,"threads_started":1}
I20260806 00:53:06.148607 5518 heartbeater.cc:347] Connected to a master server at 127.3.98.190:42695
I20260806 00:53:06.148712 5518 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:06.148933 5518 heartbeater.cc:511] Master 127.3.98.190:42695 requested a full tablet report, sending...
I20260806 00:53:06.149430 5041 ts_manager.cc:194] Registered new tserver with Master: 7918934dde8143d2b8eff270ea63f0e1 (127.3.98.130:38801)
I20260806 00:53:06.149963 5041 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:37865
I20260806 00:53:06.153106 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 5332
I20260806 00:53:06.153223 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:06.153431 3466 external_mini_cluster.cc:1428] Setting key 3cca4bb593aa6591e22dbf258e2a46f4
I20260806 00:53:06.155977 5528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.149809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:42695 (local address 127.3.98.130:41395)
0806 00:53:06.149948 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.149961 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.150024 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.150205 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.150206 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.150434 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:06.150490 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.150492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.151196 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.151197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.151898 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.151900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.152203 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.152204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.152265 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.152719 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:06.152724 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:06.153010 (+ 286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:06.154795 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:06.154796 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:06.154796 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:06.155031 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:06.155248 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:06.155248 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:06.155249 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:06.155357 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:06.155711 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:06.155712 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:06.155752 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.155810 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.155896 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":83,"threads_started":1}
I20260806 00:53:06.156075 5111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.149985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:41395 (local address 127.3.98.190:42695)
0806 00:53:06.150025 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.150026 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.150035 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:53:06.150096 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.150097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.150108 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.150162 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:06.150612 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.151111 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.151962 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.152137 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.152188 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.153096 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:06.153097 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:06.153098 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:06.153106 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:06.154709 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.155108 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.155110 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.155110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.155178 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.155423 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.155424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.155425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.155644 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:06.155717 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.155856 (+ 139us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.155944 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:53:06.181151 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42695
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:36823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:06.267455 5532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:06.267745 5532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:06.267788 5532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:06.269155 5532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:06.269234 5532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:06.269274 5532 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 00:53:06.269342 5532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:06.271008 5532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.98.190:42695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:06.271313 5532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:06.271562 5532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:06.278472 5546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:06.278472 5537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:06.278488 5538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:06.280599 5532 server_base.cc:1034] running on GCE node
I20260806 00:53:06.280916 5532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:06.282476 5532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:06.283702 5532 hybrid_clock.cc:648] HybridClock initialized: now 1785977586283673 us; error 43 us; skew 500 ppm
Aug 06 00:53:06 dist-test-slave-44d2 krb5kdc[4979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977586, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:06.287636 5532 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:53:06.288214 5532 webserver.cc:460] Webserver started at http://127.3.98.131:36703/ using document root <none> and password file <none>
I20260806 00:53:06.288537 5532 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:06.288610 5532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:06.288779 5532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:06.289914 5532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "03c6f177c30e493f91ee134ae7705b51"
format_stamp: "Formatted at 2026-08-06 00:53:06 on dist-test-slave-44d2"
server_key: "f07cd653a17cba0d6152e8cdca72f108"
server_key_iv: "24346743e40af771a07ac995dc93ba54"
server_key_version: "encryptionkey@0"
I20260806 00:53:06.290313 5532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "03c6f177c30e493f91ee134ae7705b51"
format_stamp: "Formatted at 2026-08-06 00:53:06 on dist-test-slave-44d2"
server_key: "f07cd653a17cba0d6152e8cdca72f108"
server_key_iv: "24346743e40af771a07ac995dc93ba54"
server_key_version: "encryptionkey@0"
I20260806 00:53:06.291802 5532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:06.292671 5557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:06.292857 5532 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:06.292959 5532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "03c6f177c30e493f91ee134ae7705b51"
format_stamp: "Formatted at 2026-08-06 00:53:06 on dist-test-slave-44d2"
server_key: "f07cd653a17cba0d6152e8cdca72f108"
server_key_iv: "24346743e40af771a07ac995dc93ba54"
server_key_version: "encryptionkey@0"
I20260806 00:53:06.293044 5532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:06.310277 5532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:06.312352 5532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:06.312619 5532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:06.313210 5532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:06.313285 5532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:06.313344 5532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:06.313395 5532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 00:53:06 dist-test-slave-44d2 krb5kdc[4979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977586, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:06.322096 5532 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:38179
I20260806 00:53:06.322535 5532 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:06.323252 5734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:38179 every 8 connection(s)
I20260806 00:53:06.325910 5111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.313766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:34125 (local address 127.3.98.190:42695)
0806 00:53:06.313847 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.313849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.314141 (+ 292us) server_negotiation.cc:407] Connection header received
0806 00:53:06.314938 (+ 797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.314940 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.314953 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.315001 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:06.316051 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.316790 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.318581 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.318799 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.318884 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.322553 (+ 3669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:06.322556 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:06.322556 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:06.322564 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:06.324425 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.324892 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.324894 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.324894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.324962 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.325225 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.325226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.325227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.325353 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:06.325433 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.325731 (+ 298us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.325817 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 00:53:06.326107 5573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.313734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:42695 (local address 127.3.98.131:34125)
0806 00:53:06.313971 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.314032 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.314806 (+ 774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.315098 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.315102 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.315562 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:06.315911 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.315920 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.316882 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.316883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.318430 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.318435 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.318926 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.318927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.319059 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.320590 (+ 1531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:06.320600 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:06.322433 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:06.324556 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:06.324564 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:06.324566 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:06.324806 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:06.325032 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:06.325033 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:06.325033 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:06.325152 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:06.325424 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:06.325432 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:06.325585 (+ 153us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.325693 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.325865 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":109,"threads_started":1}
I20260806 00:53:06.326694 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 5532
I20260806 00:53:06.326804 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:06.326995 3466 external_mini_cluster.cc:1428] Setting key da56fc798b5690274b78c2e7e058db22
I20260806 00:53:06.327646 5735 heartbeater.cc:347] Connected to a master server at 127.3.98.190:42695
I20260806 00:53:06.327708 5735 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:06.327886 5735 heartbeater.cc:511] Master 127.3.98.190:42695 requested a full tablet report, sending...
I20260806 00:53:06.328307 5042 ts_manager.cc:194] Registered new tserver with Master: 03c6f177c30e493f91ee134ae7705b51 (127.3.98.131:38179)
I20260806 00:53:06.328758 5042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:34125
I20260806 00:53:06.333902 5111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.327966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:57415 (local address 127.3.98.190:42695)
0806 00:53:06.328010 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.328012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.328181 (+ 169us) server_negotiation.cc:407] Connection header received
0806 00:53:06.328251 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.328251 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.328261 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.328307 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:06.328730 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.329304 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.330179 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.330411 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.330475 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.331471 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:06.331473 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:06.331473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:06.331480 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:06.332743 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.333096 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.333098 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.333098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.333152 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.333378 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.333379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.333379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.333495 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:06.333571 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.333739 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.333812 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:53:06.333915 5746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.327913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:42695 (local address 127.3.98.131:57415)
0806 00:53:06.328124 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.328135 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.328195 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.328309 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.328309 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.328583 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:06.328648 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.328650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.329412 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.329413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.330098 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.330100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.330496 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.330497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.330579 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.331035 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:06.331041 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:06.331372 (+ 331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:06.332837 (+ 1465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:06.332838 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:06.332839 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:06.333019 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:06.333227 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:06.333228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:06.333228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:06.333288 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:06.333564 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:06.333565 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:06.333611 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.333712 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.333814 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":154,"threads_started":1}
I20260806 00:53:06.338775 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 00:53:06 dist-test-slave-44d2 krb5kdc[4979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977586, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 00:53:06 dist-test-slave-44d2 krb5kdc[4979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977586, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:06.365319 5111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.357231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44648 (local address 127.3.98.190:42695)
0806 00:53:06.357301 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.357303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.357310 (+ 7us) server_negotiation.cc:407] Connection header received
0806 00:53:06.357337 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.357338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.357348 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.357416 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:06.358031 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.358548 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.359299 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.359501 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.359582 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.362097 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:06.362100 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:06.362100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:06.362112 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:06.363517 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.364314 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.364315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.364316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.364412 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.364681 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.364682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.364683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.364808 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:06.364923 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.365112 (+ 189us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.365205 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 00:53:06.367215 5042 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44648:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:06.369081 5042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:06.376255 5763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.371806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:38179 (local address 127.0.0.1:50582)
0806 00:53:06.371981 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.371992 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.372035 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.372752 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.372753 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.372756 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:06.372822 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.372824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.373999 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.374001 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.375053 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.375056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.375892 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.375894 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.375987 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.376004 (+ 17us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.376092 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.376157 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":108,"threads_started":1}
I20260806 00:53:06.376368 5767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.371850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48264 (local address 127.3.98.129:38677)
0806 00:53:06.372061 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.372067 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.372079 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:53:06.372127 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.372129 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.372148 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.372232 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:06.372539 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.373737 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.375233 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.375970 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.376045 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.376100 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.376209 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.376248 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":83,"threads_started":1}
I20260806 00:53:06.376695 5768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.372075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:38801 (local address 127.0.0.1:44758)
0806 00:53:06.372689 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.372700 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.372816 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.373067 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.373068 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.373070 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:06.373111 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.373113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.374354 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.374355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.375438 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.375441 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.376430 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.376431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.376529 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.376533 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.376586 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.376625 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":71,"threads_started":1}
I20260806 00:53:06.376717 5772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.372287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50582 (local address 127.3.98.131:38179)
0806 00:53:06.372595 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.372601 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.372612 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:53:06.372653 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.372655 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.372671 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.372751 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:06.372945 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.373820 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.375166 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.375750 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.375888 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.375963 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.376559 (+ 596us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.376607 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":137,"threads_started":1}
I20260806 00:53:06.376751 5770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.372181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44758 (local address 127.3.98.130:38801)
0806 00:53:06.372404 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.372409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.372779 (+ 370us) server_negotiation.cc:407] Connection header received
0806 00:53:06.372936 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.372940 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.372965 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.373045 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:06.373197 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.374257 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.375533 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.376268 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.376312 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.376362 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.376605 (+ 243us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.376645 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":104,"threads_started":1}
I20260806 00:53:06.377357 5762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.371705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:38677 (local address 127.0.0.1:48264)
0806 00:53:06.371880 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.371930 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.372004 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.372317 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.372322 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.372325 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:06.372416 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.372418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.373841 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.373842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.375136 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.375138 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.376048 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.376049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.376117 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.376122 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.376195 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.376232 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":62,"threads_started":1}
I20260806 00:53:06.377454 5627 tablet_service.cc:1467] Processing CreateTablet for tablet 2c8e5c50837d470f92d6da166b696c05 (DEFAULT_TABLE table=test-table [id=42be020096694bf6b0f34d0a56d36174]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:06.377548 5434 tablet_service.cc:1467] Processing CreateTablet for tablet 2c8e5c50837d470f92d6da166b696c05 (DEFAULT_TABLE table=test-table [id=42be020096694bf6b0f34d0a56d36174]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:06.377882 5627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c8e5c50837d470f92d6da166b696c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:06.378031 5434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c8e5c50837d470f92d6da166b696c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:06.380730 5774 tablet_bootstrap.cc:492] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51: Bootstrap starting.
I20260806 00:53:06.381302 5231 tablet_service.cc:1467] Processing CreateTablet for tablet 2c8e5c50837d470f92d6da166b696c05 (DEFAULT_TABLE table=test-table [id=42be020096694bf6b0f34d0a56d36174]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:06.381574 5775 tablet_bootstrap.cc:492] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1: Bootstrap starting.
I20260806 00:53:06.381629 5774 tablet_bootstrap.cc:654] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:06.381716 5231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c8e5c50837d470f92d6da166b696c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:06.382040 5774 log.cc:824] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:06.382269 5775 tablet_bootstrap.cc:654] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:06.382575 5775 log.cc:824] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:06.382964 5774 tablet_bootstrap.cc:492] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51: No bootstrap required, opened a new log
I20260806 00:53:06.383050 5774 ts_tablet_manager.cc:1397] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:53:06.383455 5775 tablet_bootstrap.cc:492] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1: No bootstrap required, opened a new log
I20260806 00:53:06.383549 5775 ts_tablet_manager.cc:1397] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:53:06.385111 5774 raft_consensus.cc:348] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } }
I20260806 00:53:06.385285 5774 raft_consensus.cc:374] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:06.385337 5774 raft_consensus.cc:729] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03c6f177c30e493f91ee134ae7705b51, State: Initialized, Role: FOLLOWER
I20260806 00:53:06.385392 5782 tablet_bootstrap.cc:492] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8: Bootstrap starting.
I20260806 00:53:06.385493 5774 consensus_queue.cc:260] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } }
I20260806 00:53:06.385778 5774 ts_tablet_manager.cc:1428] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:53:06.385681 5775 raft_consensus.cc:348] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } }
I20260806 00:53:06.385865 5775 raft_consensus.cc:374] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:06.385918 5775 raft_consensus.cc:729] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7918934dde8143d2b8eff270ea63f0e1, State: Initialized, Role: FOLLOWER
I20260806 00:53:06.386042 5775 consensus_queue.cc:260] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } }
I20260806 00:53:06.386099 5782 tablet_bootstrap.cc:654] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:06.386229 5735 heartbeater.cc:503] Master 127.3.98.190:42695 was elected leader, sending a full tablet report...
I20260806 00:53:06.386377 5775 ts_tablet_manager.cc:1428] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:53:06.386504 5518 heartbeater.cc:503] Master 127.3.98.190:42695 was elected leader, sending a full tablet report...
I20260806 00:53:06.386505 5782 log.cc:824] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:06.387277 5782 tablet_bootstrap.cc:492] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8: No bootstrap required, opened a new log
I20260806 00:53:06.387364 5782 ts_tablet_manager.cc:1397] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:53:06.388825 5782 raft_consensus.cc:348] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } }
I20260806 00:53:06.389001 5782 raft_consensus.cc:374] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:06.389039 5782 raft_consensus.cc:729] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecf1fbe91414bf191fa76e717e53db8, State: Initialized, Role: FOLLOWER
I20260806 00:53:06.389154 5782 consensus_queue.cc:260] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } }
I20260806 00:53:06.389513 5782 ts_tablet_manager.cc:1428] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:53:06.389550 5321 heartbeater.cc:503] Master 127.3.98.190:42695 was elected leader, sending a full tablet report...
W20260806 00:53:06.395817 5520 tablet.cc:2369] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:53:06.396631 5787 raft_consensus.cc:482] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:06.396783 5787 raft_consensus.cc:504] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } }
I20260806 00:53:06.397223 5787 leader_election.cc:288] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03c6f177c30e493f91ee134ae7705b51 (127.3.98.131:38179), 7918934dde8143d2b8eff270ea63f0e1 (127.3.98.130:38801)
I20260806 00:53:06.401285 5175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.397478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:38179 (local address 127.3.98.129:50779)
0806 00:53:06.397548 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.397563 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.397621 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.397808 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.397809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.397811 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:06.397892 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.397893 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.398911 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.398912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.400088 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.400091 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.400992 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.400993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.401061 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.401064 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.401147 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.401192 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 00:53:06.401367 5772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.397544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:50779 (local address 127.3.98.131:38179)
0806 00:53:06.397626 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.397628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.397643 (+ 15us) server_negotiation.cc:407] Connection header received
0806 00:53:06.397684 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.397685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.397700 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.397776 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:06.397960 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.398815 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.400193 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.400898 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.401000 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.401012 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.401195 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.401252 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 00:53:06.401448 5770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.397794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:44503 (local address 127.3.98.130:38801)
0806 00:53:06.397841 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.397843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.398106 (+ 263us) server_negotiation.cc:407] Connection header received
0806 00:53:06.398142 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.398144 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.398159 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.398246 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:06.398337 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.399063 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.400306 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.401052 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.401180 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.401191 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.401326 (+ 135us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.401369 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 00:53:06.401809 5788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.397651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:38801 (local address 127.3.98.129:44503)
0806 00:53:06.398025 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.398034 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.398083 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.398243 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.398243 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.398244 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:06.398294 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.398295 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.399140 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.399141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.400217 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.400219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.401177 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.401178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.401242 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.401246 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.401299 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.401729 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":307,"threads_started":1}
I20260806 00:53:06.401764 5653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c8e5c50837d470f92d6da166b696c05" candidate_uuid: "0ecf1fbe91414bf191fa76e717e53db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c6f177c30e493f91ee134ae7705b51" is_pre_election: true
I20260806 00:53:06.401978 5653 raft_consensus.cc:2454] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecf1fbe91414bf191fa76e717e53db8 in term 0.
I20260806 00:53:06.402179 5462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c8e5c50837d470f92d6da166b696c05" candidate_uuid: "0ecf1fbe91414bf191fa76e717e53db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7918934dde8143d2b8eff270ea63f0e1" is_pre_election: true
I20260806 00:53:06.402406 5462 raft_consensus.cc:2454] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecf1fbe91414bf191fa76e717e53db8 in term 0.
I20260806 00:53:06.402711 5157 leader_election.cc:302] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ecf1fbe91414bf191fa76e717e53db8, 7918934dde8143d2b8eff270ea63f0e1; no voters:
I20260806 00:53:06.402859 5787 raft_consensus.cc:2781] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:06.402961 5787 raft_consensus.cc:482] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:06.402992 5787 raft_consensus.cc:3037] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:06.403851 5787 raft_consensus.cc:504] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } }
I20260806 00:53:06.404021 5787 leader_election.cc:288] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [CANDIDATE]: Term 1 election: Requested vote from peers 03c6f177c30e493f91ee134ae7705b51 (127.3.98.131:38179), 7918934dde8143d2b8eff270ea63f0e1 (127.3.98.130:38801)
I20260806 00:53:06.404244 5653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c8e5c50837d470f92d6da166b696c05" candidate_uuid: "0ecf1fbe91414bf191fa76e717e53db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c6f177c30e493f91ee134ae7705b51"
I20260806 00:53:06.404233 5462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c8e5c50837d470f92d6da166b696c05" candidate_uuid: "0ecf1fbe91414bf191fa76e717e53db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7918934dde8143d2b8eff270ea63f0e1"
I20260806 00:53:06.404330 5462 raft_consensus.cc:3037] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:06.404330 5653 raft_consensus.cc:3037] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:06.405335 5462 raft_consensus.cc:2454] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecf1fbe91414bf191fa76e717e53db8 in term 1.
I20260806 00:53:06.405335 5653 raft_consensus.cc:2454] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecf1fbe91414bf191fa76e717e53db8 in term 1.
I20260806 00:53:06.405576 5157 leader_election.cc:302] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03c6f177c30e493f91ee134ae7705b51, 0ecf1fbe91414bf191fa76e717e53db8; no voters:
I20260806 00:53:06.405678 5787 raft_consensus.cc:2781] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:06.405843 5787 raft_consensus.cc:686] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecf1fbe91414bf191fa76e717e53db8, State: Running, Role: LEADER
I20260806 00:53:06.405951 5787 consensus_queue.cc:237] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } }
I20260806 00:53:06.407001 5042 catalog_manager.cc:5495] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ecf1fbe91414bf191fa76e717e53db8 (127.3.98.129). New cstate: current_term: 1 leader_uuid: "0ecf1fbe91414bf191fa76e717e53db8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } health_report { overall_health: UNKNOWN } } }
I20260806 00:53:06.416044 5767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.413576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48274 (local address 127.3.98.129:38677)
0806 00:53:06.413637 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.413639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.413649 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:06.413747 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.413748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.413765 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.413824 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:06.413942 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.414395 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.415126 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.415299 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.415350 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.415523 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:06.415641 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:06.415704 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.415751 (+ 47us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.415772 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 00:53:06.417924 5653 raft_consensus.cc:1261] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51 [term 1 FOLLOWER]: Refusing update from remote peer 0ecf1fbe91414bf191fa76e717e53db8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:06.417924 5462 raft_consensus.cc:1261] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1 [term 1 FOLLOWER]: Refusing update from remote peer 0ecf1fbe91414bf191fa76e717e53db8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:06.418303 5787 consensus_queue.cc:1035] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:06.420379 5787 consensus_queue.cc:1035] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:06.421634 5796 mvcc.cc:205] Tried to move back new op lower bound from 7315364193964556288 to 7315364193919815680. Current Snapshot: MvccSnapshot[applied={T|T < 7315364193964556288 or (T in {7315364193964556288})}]
I20260806 00:53:06.424202 5805 mvcc.cc:205] Tried to move back new op lower bound from 7315364193964556288 to 7315364193919815680. Current Snapshot: MvccSnapshot[applied={T|T < 7315364193964556288}]
I20260806 00:53:06.425760 5042 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:06.425899 5042 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:06.427018 5042 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3: Sending DeleteTablet for 3 replicas of tablet 2c8e5c50837d470f92d6da166b696c05
I20260806 00:53:06.427631 5434 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c8e5c50837d470f92d6da166b696c05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:06 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:44758
I20260806 00:53:06.427630 5231 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c8e5c50837d470f92d6da166b696c05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:06 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:48264
I20260806 00:53:06.427932 5627 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c8e5c50837d470f92d6da166b696c05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:06 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:50582
I20260806 00:53:06.428153 5812 tablet_replica.cc:330] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1: stopping tablet replica
I20260806 00:53:06.428158 5042 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44648:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 00:53:06.428265 5812 raft_consensus.cc:2229] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:06.428303 5813 tablet_replica.cc:330] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8: stopping tablet replica
W20260806 00:53:06.428350 5042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:06.428366 5812 raft_consensus.cc:2258] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:06.428406 5813 raft_consensus.cc:2229] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:53:06.428927 5812 ts_tablet_manager.cc:1905] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:06.428994 5814 tablet_replica.cc:330] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51: stopping tablet replica
I20260806 00:53:06.429109 5814 raft_consensus.cc:2229] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:06.429255 5814 raft_consensus.cc:2258] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:06.429420 5813 raft_consensus.cc:2258] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:06.429827 5434 tablet_service.cc:1467] Processing CreateTablet for tablet a268c683310f46709ec40a85fbc8c435 (DEFAULT_TABLE table=test-table [id=3b718aa766954b8795bee63fc6684062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:06.429849 5627 tablet_service.cc:1467] Processing CreateTablet for tablet a268c683310f46709ec40a85fbc8c435 (DEFAULT_TABLE table=test-table [id=3b718aa766954b8795bee63fc6684062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:06.430013 5627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a268c683310f46709ec40a85fbc8c435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:06.430101 5434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a268c683310f46709ec40a85fbc8c435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:06.430212 5231 tablet_service.cc:1467] Processing CreateTablet for tablet a268c683310f46709ec40a85fbc8c435 (DEFAULT_TABLE table=test-table [id=3b718aa766954b8795bee63fc6684062]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:06.430333 5231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a268c683310f46709ec40a85fbc8c435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:06.431650 5775 tablet_bootstrap.cc:492] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1: Bootstrap starting.
I20260806 00:53:06.431815 5774 tablet_bootstrap.cc:492] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51: Bootstrap starting.
I20260806 00:53:06.432140 5775 tablet_bootstrap.cc:654] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:06.432144 5782 tablet_bootstrap.cc:492] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8: Bootstrap starting.
I20260806 00:53:06.432610 5774 tablet_bootstrap.cc:654] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:06.432794 5782 tablet_bootstrap.cc:654] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:06.433260 5812 ts_tablet_manager.cc:1918] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:06.433368 5812 log.cc:1196] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/2c8e5c50837d470f92d6da166b696c05
I20260806 00:53:06.433667 5812 ts_tablet_manager.cc:1939] T 2c8e5c50837d470f92d6da166b696c05 P 7918934dde8143d2b8eff270ea63f0e1: Deleting consensus metadata
I20260806 00:53:06.433743 5813 ts_tablet_manager.cc:1905] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:06.434105 5775 tablet_bootstrap.cc:492] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1: No bootstrap required, opened a new log
I20260806 00:53:06.434172 5775 ts_tablet_manager.cc:1397] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 00:53:06.434317 5775 raft_consensus.cc:348] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.434387 5775 raft_consensus.cc:374] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:06.434408 5775 raft_consensus.cc:729] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7918934dde8143d2b8eff270ea63f0e1, State: Initialized, Role: FOLLOWER
I20260806 00:53:06.434297 5018 catalog_manager.cc:4841] TS 7918934dde8143d2b8eff270ea63f0e1 (127.3.98.130:38801): tablet 2c8e5c50837d470f92d6da166b696c05 (table test-table [id=42be020096694bf6b0f34d0a56d36174]) successfully deleted
I20260806 00:53:06.434451 5775 consensus_queue.cc:260] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.434536 5775 ts_tablet_manager.cc:1428] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:06.435642 5813 ts_tablet_manager.cc:1918] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:06.435771 5813 log.cc:1196] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/wal/wals/2c8e5c50837d470f92d6da166b696c05
I20260806 00:53:06.436136 5813 ts_tablet_manager.cc:1939] T 2c8e5c50837d470f92d6da166b696c05 P 0ecf1fbe91414bf191fa76e717e53db8: Deleting consensus metadata
I20260806 00:53:06.436683 5020 catalog_manager.cc:4841] TS 0ecf1fbe91414bf191fa76e717e53db8 (127.3.98.129:38677): tablet 2c8e5c50837d470f92d6da166b696c05 (table test-table [id=42be020096694bf6b0f34d0a56d36174]) successfully deleted
I20260806 00:53:06.436906 5814 ts_tablet_manager.cc:1905] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:06.438679 5814 ts_tablet_manager.cc:1918] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:06.438768 5814 log.cc:1196] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/2c8e5c50837d470f92d6da166b696c05
I20260806 00:53:06.439038 5814 ts_tablet_manager.cc:1939] T 2c8e5c50837d470f92d6da166b696c05 P 03c6f177c30e493f91ee134ae7705b51: Deleting consensus metadata
I20260806 00:53:06.439601 5018 catalog_manager.cc:4841] TS 03c6f177c30e493f91ee134ae7705b51 (127.3.98.131:38179): tablet 2c8e5c50837d470f92d6da166b696c05 (table test-table [id=42be020096694bf6b0f34d0a56d36174]) successfully deleted
I20260806 00:53:06.439659 5782 tablet_bootstrap.cc:492] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8: No bootstrap required, opened a new log
I20260806 00:53:06.439707 5782 ts_tablet_manager.cc:1397] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20260806 00:53:06.439893 5774 tablet_bootstrap.cc:492] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51: No bootstrap required, opened a new log
I20260806 00:53:06.439932 5774 ts_tablet_manager.cc:1397] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20260806 00:53:06.439878 5782 raft_consensus.cc:348] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.440001 5782 raft_consensus.cc:374] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:06.440029 5782 raft_consensus.cc:729] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecf1fbe91414bf191fa76e717e53db8, State: Initialized, Role: FOLLOWER
I20260806 00:53:06.440076 5782 consensus_queue.cc:260] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.440085 5774 raft_consensus.cc:348] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.440148 5774 raft_consensus.cc:374] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:06.440167 5774 raft_consensus.cc:729] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03c6f177c30e493f91ee134ae7705b51, State: Initialized, Role: FOLLOWER
I20260806 00:53:06.440172 5782 ts_tablet_manager.cc:1428] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:06.440219 5774 consensus_queue.cc:260] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.440315 5774 ts_tablet_manager.cc:1428] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
W20260806 00:53:06.447003 5322 tablet.cc:2369] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:53:06.450387 5802 raft_consensus.cc:482] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:06.450465 5802 raft_consensus.cc:504] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.450635 5802 leader_election.cc:288] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7918934dde8143d2b8eff270ea63f0e1 (127.3.98.130:38801), 03c6f177c30e493f91ee134ae7705b51 (127.3.98.131:38179)
I20260806 00:53:06.450835 5462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a268c683310f46709ec40a85fbc8c435" candidate_uuid: "0ecf1fbe91414bf191fa76e717e53db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7918934dde8143d2b8eff270ea63f0e1" is_pre_election: true
I20260806 00:53:06.450855 5653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a268c683310f46709ec40a85fbc8c435" candidate_uuid: "0ecf1fbe91414bf191fa76e717e53db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c6f177c30e493f91ee134ae7705b51" is_pre_election: true
I20260806 00:53:06.450958 5653 raft_consensus.cc:2454] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecf1fbe91414bf191fa76e717e53db8 in term 0.
I20260806 00:53:06.451000 5462 raft_consensus.cc:2454] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ecf1fbe91414bf191fa76e717e53db8 in term 0.
I20260806 00:53:06.451133 5157 leader_election.cc:302] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03c6f177c30e493f91ee134ae7705b51, 0ecf1fbe91414bf191fa76e717e53db8; no voters:
I20260806 00:53:06.451251 5802 raft_consensus.cc:2781] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:06.451287 5802 raft_consensus.cc:482] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:06.451308 5802 raft_consensus.cc:3037] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:06.452237 5802 raft_consensus.cc:504] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.452365 5802 leader_election.cc:288] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [CANDIDATE]: Term 1 election: Requested vote from peers 7918934dde8143d2b8eff270ea63f0e1 (127.3.98.130:38801), 03c6f177c30e493f91ee134ae7705b51 (127.3.98.131:38179)
I20260806 00:53:06.452611 5653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a268c683310f46709ec40a85fbc8c435" candidate_uuid: "0ecf1fbe91414bf191fa76e717e53db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03c6f177c30e493f91ee134ae7705b51"
I20260806 00:53:06.452688 5653 raft_consensus.cc:3037] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:06.453436 5653 raft_consensus.cc:2454] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecf1fbe91414bf191fa76e717e53db8 in term 1.
I20260806 00:53:06.453555 5462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a268c683310f46709ec40a85fbc8c435" candidate_uuid: "0ecf1fbe91414bf191fa76e717e53db8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7918934dde8143d2b8eff270ea63f0e1"
I20260806 00:53:06.453616 5157 leader_election.cc:302] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03c6f177c30e493f91ee134ae7705b51, 0ecf1fbe91414bf191fa76e717e53db8; no voters:
I20260806 00:53:06.453639 5462 raft_consensus.cc:3037] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:06.453708 5802 raft_consensus.cc:2781] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:06.453761 5802 raft_consensus.cc:686] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [term 1 LEADER]: Becoming Leader. State: Replica: 0ecf1fbe91414bf191fa76e717e53db8, State: Running, Role: LEADER
I20260806 00:53:06.453814 5802 consensus_queue.cc:237] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.454447 5462 raft_consensus.cc:2454] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ecf1fbe91414bf191fa76e717e53db8 in term 1.
I20260806 00:53:06.454385 5041 catalog_manager.cc:5495] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ecf1fbe91414bf191fa76e717e53db8 (127.3.98.129). New cstate: current_term: 1 leader_uuid: "0ecf1fbe91414bf191fa76e717e53db8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } health_report { overall_health: UNKNOWN } } }
Aug 06 00:53:06 dist-test-slave-44d2 krb5kdc[4979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977585, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:06.497531 5111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.489378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44662 (local address 127.3.98.190:42695)
0806 00:53:06.489451 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.489453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.489583 (+ 130us) server_negotiation.cc:407] Connection header received
0806 00:53:06.489671 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.489672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.489689 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.489767 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:06.490338 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.490858 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.491569 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.491755 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.491831 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.494248 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:06.494250 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:06.494251 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:06.494258 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:06.495864 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.496555 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.496556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.496556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.496617 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.497010 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.497010 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.497011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.497126 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:06.497182 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.497387 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.497465 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 00:53:06.497663 5824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.489321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:42695 (local address 127.0.0.1:44662)
0806 00:53:06.489506 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.489516 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.489606 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.489776 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.489777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.490190 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:06.490242 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.490246 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.490960 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.490961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.491486 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.491487 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.491828 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.491830 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.491881 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.492471 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:06.492475 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:06.494143 (+ 1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:06.495950 (+ 1807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:06.495957 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:06.495960 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:06.496373 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:06.496703 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:06.496705 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:06.496705 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:06.496796 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:06.497202 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:06.497210 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:06.497271 (+ 61us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.497362 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.497547 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":55,"thread_start_us":84,"threads_started":1}
I20260806 00:53:06.500120 5041 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:44662:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 00:53:06.500432 5041 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:06.502279 5231 tablet_service.cc:1467] Processing CreateTablet for tablet 1b2dd63ecb1f48aba9fc02d4c564f495 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=230daa20b72746dea2c582d9524296c0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 00:53:06.502364 5434 tablet_service.cc:1467] Processing CreateTablet for tablet 1b2dd63ecb1f48aba9fc02d4c564f495 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=230daa20b72746dea2c582d9524296c0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 00:53:06.502535 5231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b2dd63ecb1f48aba9fc02d4c564f495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:06.502622 5434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b2dd63ecb1f48aba9fc02d4c564f495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:06.503885 5627 tablet_service.cc:1467] Processing CreateTablet for tablet 1b2dd63ecb1f48aba9fc02d4c564f495 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=230daa20b72746dea2c582d9524296c0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 00:53:06.504052 5627 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b2dd63ecb1f48aba9fc02d4c564f495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:06.505191 5775 tablet_bootstrap.cc:492] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1: Bootstrap starting.
I20260806 00:53:06.505559 5774 tablet_bootstrap.cc:492] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: Bootstrap starting.
I20260806 00:53:06.505592 5782 tablet_bootstrap.cc:492] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8: Bootstrap starting.
I20260806 00:53:06.505750 5775 tablet_bootstrap.cc:654] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:06.506022 5774 tablet_bootstrap.cc:654] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:06.506032 5782 tablet_bootstrap.cc:654] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:06.506881 5775 tablet_bootstrap.cc:492] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1: No bootstrap required, opened a new log
I20260806 00:53:06.506891 5782 tablet_bootstrap.cc:492] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8: No bootstrap required, opened a new log
I20260806 00:53:06.506937 5782 ts_tablet_manager.cc:1397] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:06.506937 5775 ts_tablet_manager.cc:1397] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:53:06.506992 5774 tablet_bootstrap.cc:492] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: No bootstrap required, opened a new log
I20260806 00:53:06.507047 5774 ts_tablet_manager.cc:1397] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 00:53:06.507117 5782 raft_consensus.cc:348] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.507117 5775 raft_consensus.cc:348] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.507184 5782 raft_consensus.cc:374] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:06.507184 5775 raft_consensus.cc:374] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:06.507206 5775 raft_consensus.cc:729] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7918934dde8143d2b8eff270ea63f0e1, State: Initialized, Role: FOLLOWER
I20260806 00:53:06.507206 5782 raft_consensus.cc:729] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ecf1fbe91414bf191fa76e717e53db8, State: Initialized, Role: FOLLOWER
I20260806 00:53:06.507249 5775 consensus_queue.cc:260] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.507249 5782 consensus_queue.cc:260] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.507207 5774 raft_consensus.cc:348] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.507336 5774 raft_consensus.cc:374] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:06.507365 5774 raft_consensus.cc:729] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03c6f177c30e493f91ee134ae7705b51, State: Initialized, Role: FOLLOWER
I20260806 00:53:06.507376 5775 ts_tablet_manager.cc:1428] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:06.507387 5782 ts_tablet_manager.cc:1428] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:06.507426 5774 consensus_queue.cc:260] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.507531 5774 ts_tablet_manager.cc:1428] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:06.507541 5785 tablet_replica.cc:439] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } }
I20260806 00:53:06.507596 5802 tablet_replica.cc:439] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } }
I20260806 00:53:06.507632 5785 tablet_replica.cc:442] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:06.507664 5802 tablet_replica.cc:442] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:06.507920 5784 tablet_replica.cc:439] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } }
I20260806 00:53:06.508034 5784 tablet_replica.cc:442] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:06.552722 5784 raft_consensus.cc:482] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:06.552852 5784 raft_consensus.cc:504] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.553251 5784 leader_election.cc:288] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ecf1fbe91414bf191fa76e717e53db8 (127.3.98.129:38677), 7918934dde8143d2b8eff270ea63f0e1 (127.3.98.130:38801)
I20260806 00:53:06.557542 5573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.553476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:38801 (local address 127.3.98.131:45823)
0806 00:53:06.553631 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.553644 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.553689 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.553956 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.553957 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.553959 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:06.554038 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.554041 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.555021 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.555023 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.556296 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.556300 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.557242 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.557243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.557330 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.557335 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.557392 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.557444 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130}
I20260806 00:53:06.557937 5770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.553636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:45823 (local address 127.3.98.130:38801)
0806 00:53:06.553692 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.553694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.553704 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:06.553792 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.553794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.553807 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.553891 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:06.554147 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.554902 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.556460 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.557104 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.557186 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.557198 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.557801 (+ 603us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.557867 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 00:53:06.558133 5462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b2dd63ecb1f48aba9fc02d4c564f495" candidate_uuid: "03c6f177c30e493f91ee134ae7705b51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7918934dde8143d2b8eff270ea63f0e1" is_pre_election: true
I20260806 00:53:06.558224 5462 raft_consensus.cc:2454] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03c6f177c30e493f91ee134ae7705b51 in term 0.
I20260806 00:53:06.558444 5558 leader_election.cc:302] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03c6f177c30e493f91ee134ae7705b51, 7918934dde8143d2b8eff270ea63f0e1; no voters:
I20260806 00:53:06.558581 5784 raft_consensus.cc:2781] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:06.558625 5784 raft_consensus.cc:482] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:06.558655 5784 raft_consensus.cc:3037] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:06.559118 5767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.553803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:39515 (local address 127.3.98.129:38677)
0806 00:53:06.553854 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.553856 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.554228 (+ 372us) server_negotiation.cc:407] Connection header received
0806 00:53:06.554309 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.554310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.554321 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.554376 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:06.554664 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.555502 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.557359 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.558046 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.558108 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.558120 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.558958 (+ 838us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.559019 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 00:53:06.559654 5832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.553484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:38677 (local address 127.3.98.131:39515)
0806 00:53:06.554153 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.554162 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.554240 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.554437 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.554438 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.554440 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:06.554539 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.554541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.555680 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.555681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.557244 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.557248 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.558750 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.558751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.558852 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.558856 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.559469 (+ 613us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.559531 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"mutex_wait_us":464,"thread_start_us":144,"threads_started":1}
I20260806 00:53:06.560127 5256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b2dd63ecb1f48aba9fc02d4c564f495" candidate_uuid: "03c6f177c30e493f91ee134ae7705b51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecf1fbe91414bf191fa76e717e53db8" is_pre_election: true
I20260806 00:53:06.560175 5784 raft_consensus.cc:504] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.560292 5256 raft_consensus.cc:2454] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03c6f177c30e493f91ee134ae7705b51 in term 0.
I20260806 00:53:06.560336 5784 leader_election.cc:288] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [CANDIDATE]: Term 1 election: Requested vote from peers 0ecf1fbe91414bf191fa76e717e53db8 (127.3.98.129:38677), 7918934dde8143d2b8eff270ea63f0e1 (127.3.98.130:38801)
I20260806 00:53:06.560545 5256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b2dd63ecb1f48aba9fc02d4c564f495" candidate_uuid: "03c6f177c30e493f91ee134ae7705b51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ecf1fbe91414bf191fa76e717e53db8"
I20260806 00:53:06.560635 5256 raft_consensus.cc:3037] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:06.560746 5462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b2dd63ecb1f48aba9fc02d4c564f495" candidate_uuid: "03c6f177c30e493f91ee134ae7705b51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7918934dde8143d2b8eff270ea63f0e1"
I20260806 00:53:06.560858 5462 raft_consensus.cc:3037] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:06.561622 5256 raft_consensus.cc:2454] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03c6f177c30e493f91ee134ae7705b51 in term 1.
I20260806 00:53:06.561703 5462 raft_consensus.cc:2454] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03c6f177c30e493f91ee134ae7705b51 in term 1.
I20260806 00:53:06.561851 5559 leader_election.cc:302] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03c6f177c30e493f91ee134ae7705b51, 0ecf1fbe91414bf191fa76e717e53db8; no voters:
I20260806 00:53:06.562055 5784 raft_consensus.cc:2781] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:06.562222 5784 raft_consensus.cc:686] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [term 1 LEADER]: Becoming Leader. State: Replica: 03c6f177c30e493f91ee134ae7705b51, State: Running, Role: LEADER
I20260806 00:53:06.562302 5784 consensus_queue.cc:237] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } }
I20260806 00:53:06.562848 5833 tablet_replica.cc:439] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: TxnStatusTablet state changed. Reason: New leader 03c6f177c30e493f91ee134ae7705b51. Latest consensus state: current_term: 1 leader_uuid: "03c6f177c30e493f91ee134ae7705b51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } }
I20260806 00:53:06.562968 5833 tablet_replica.cc:442] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: This TxnStatusTablet replica's current role is: LEADER
I20260806 00:53:06.563158 5837 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 00:53:06.563203 5041 catalog_manager.cc:5495] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03c6f177c30e493f91ee134ae7705b51 (127.3.98.131). New cstate: current_term: 1 leader_uuid: "03c6f177c30e493f91ee134ae7705b51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } health_report { overall_health: HEALTHY } } }
I20260806 00:53:06.563519 5837 txn_status_manager.cc:929] Loading transaction status metadata into memory...
W20260806 00:53:06.573439 5741 tablet.cc:2369] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:53:06.583849 5824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.581145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:38179 (local address 127.0.0.1:50590)
0806 00:53:06.581295 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.581306 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.581393 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.581572 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.581573 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.581574 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 00:53:06.581631 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.581634 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.582308 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.582309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.582884 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.582886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.583271 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.583272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.583340 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.583366 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 00:53:06.583662 (+ 296us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 00:53:06.583674 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.583720 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.583776 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260806 00:53:06.583824 5772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.581231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50590 (local address 127.3.98.131:38179)
0806 00:53:06.581290 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.581292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.581370 (+ 78us) server_negotiation.cc:407] Connection header received
0806 00:53:06.581472 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.581473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.581493 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.581559 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:06.581700 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.582209 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.582981 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.583192 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.583270 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.583465 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:06.583582 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:06.583666 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.583722 (+ 56us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.583747 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 00:53:06.586627 5256 raft_consensus.cc:1261] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8 [term 1 FOLLOWER]: Refusing update from remote peer 03c6f177c30e493f91ee134ae7705b51: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:06.586963 5462 raft_consensus.cc:1261] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1 [term 1 FOLLOWER]: Refusing update from remote peer 03c6f177c30e493f91ee134ae7705b51: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:06.587234 5833 consensus_queue.cc:1035] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:06.587405 5784 consensus_queue.cc:1035] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:06.587962 5802 tablet_replica.cc:439] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8: TxnStatusTablet state changed. Reason: New leader 03c6f177c30e493f91ee134ae7705b51. Latest consensus state: current_term: 1 leader_uuid: "03c6f177c30e493f91ee134ae7705b51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } }
I20260806 00:53:06.588058 5802 tablet_replica.cc:442] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:06.588630 5785 tablet_replica.cc:439] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1: TxnStatusTablet state changed. Reason: New leader 03c6f177c30e493f91ee134ae7705b51. Latest consensus state: current_term: 1 leader_uuid: "03c6f177c30e493f91ee134ae7705b51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } }
I20260806 00:53:06.588754 5785 tablet_replica.cc:442] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:06.589548 5833 tablet_replica.cc:439] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03c6f177c30e493f91ee134ae7705b51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } }
I20260806 00:53:06.589651 5833 tablet_replica.cc:442] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: This TxnStatusTablet replica's current role is: LEADER
I20260806 00:53:06.589704 5833 tablet_replica.cc:439] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "03c6f177c30e493f91ee134ae7705b51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } }
I20260806 00:53:06.589752 5833 tablet_replica.cc:442] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 03c6f177c30e493f91ee134ae7705b51: This TxnStatusTablet replica's current role is: LEADER
I20260806 00:53:06.589813 5798 mvcc.cc:205] Tried to move back new op lower bound from 7315364194656157696 to 7315364194559766528. Current Snapshot: MvccSnapshot[applied={T|T < 7315364194656157696}]
I20260806 00:53:06.590128 5802 tablet_replica.cc:439] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03c6f177c30e493f91ee134ae7705b51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } }
I20260806 00:53:06.590217 5802 tablet_replica.cc:442] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 0ecf1fbe91414bf191fa76e717e53db8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:06.591710 5785 tablet_replica.cc:439] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "03c6f177c30e493f91ee134ae7705b51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ecf1fbe91414bf191fa76e717e53db8" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38677 } } peers { permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 } } peers { permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 } } }
I20260806 00:53:06.591814 5785 tablet_replica.cc:442] T 1b2dd63ecb1f48aba9fc02d4c564f495 P 7918934dde8143d2b8eff270ea63f0e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:06.597381 5772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.594477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:54713 (local address 127.3.98.131:38179)
0806 00:53:06.594522 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.594524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.594702 (+ 178us) server_negotiation.cc:407] Connection header received
0806 00:53:06.594762 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.594762 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.594772 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.594840 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:06.595003 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.595588 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.596467 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.596821 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.596907 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.597127 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:06.597163 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:06.597217 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.597278 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.597302 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:53:06.597427 5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.594432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:38179 (local address 127.3.98.129:54713)
0806 00:53:06.594616 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.594629 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.594701 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.594860 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.594862 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.594864 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 00:53:06.594917 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.594919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.595667 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.595668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.596378 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.596381 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.596951 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.596952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.597003 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.597024 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 00:53:06.597227 (+ 203us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 00:53:06.597229 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.597275 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.597339 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
I20260806 00:53:06.600364 5462 raft_consensus.cc:1261] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1 [term 1 FOLLOWER]: Refusing update from remote peer 0ecf1fbe91414bf191fa76e717e53db8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:06.600354 5653 raft_consensus.cc:1261] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51 [term 1 FOLLOWER]: Refusing update from remote peer 0ecf1fbe91414bf191fa76e717e53db8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:06.600596 5787 consensus_queue.cc:1035] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03c6f177c30e493f91ee134ae7705b51" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:06.600706 5802 consensus_queue.cc:1035] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7918934dde8143d2b8eff270ea63f0e1" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:06.613101 5767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.610401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:47007 (local address 127.3.98.129:38677)
0806 00:53:06.610440 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.610442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.610457 (+ 15us) server_negotiation.cc:407] Connection header received
0806 00:53:06.610545 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.610546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.610557 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.610621 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:06.610779 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.611477 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.612262 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.612529 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.612604 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.612810 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:06.612856 (+ 46us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:06.612940 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.613001 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.613023 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 00:53:06.613111 5746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.610300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:38677 (local address 127.3.98.131:47007)
0806 00:53:06.610400 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:06.610416 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:06.610474 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:06.610637 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:06.610638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:06.610639 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 00:53:06.610702 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.610704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.611561 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.611562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.612170 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:06.612171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.612640 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.612641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:06.612702 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.612720 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 00:53:06.612944 (+ 224us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 00:53:06.612947 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:06.612989 (+ 42us) client_negotiation.cc:240] Negotiation successful
0806 00:53:06.613035 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260806 00:53:06.622161 5041 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:06.622295 5041 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:06.623082 5041 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 328e37b04e8a441587f25332e9c5cde3: Sending DeleteTablet for 3 replicas of tablet a268c683310f46709ec40a85fbc8c435
I20260806 00:53:06.623457 5627 tablet_service.cc:1514] Processing DeleteTablet for tablet a268c683310f46709ec40a85fbc8c435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:06 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:50582
I20260806 00:53:06.623437 5434 tablet_service.cc:1514] Processing DeleteTablet for tablet a268c683310f46709ec40a85fbc8c435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:06 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:44758
I20260806 00:53:06.623555 5812 tablet_replica.cc:330] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1: stopping tablet replica
I20260806 00:53:06.623564 5814 tablet_replica.cc:330] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51: stopping tablet replica
I20260806 00:53:06.623610 5812 raft_consensus.cc:2229] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:06.623615 5814 raft_consensus.cc:2229] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:06.623651 5814 raft_consensus.cc:2258] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:06.623651 5812 raft_consensus.cc:2258] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:06.623956 5231 tablet_service.cc:1514] Processing DeleteTablet for tablet a268c683310f46709ec40a85fbc8c435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:06 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:48264
I20260806 00:53:06.624086 5813 tablet_replica.cc:330] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8: stopping tablet replica
I20260806 00:53:06.624169 5813 raft_consensus.cc:2229] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:53:06.624217 5812 ts_tablet_manager.cc:1905] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:06.624236 5813 raft_consensus.cc:2258] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:06.624603 5813 ts_tablet_manager.cc:1905] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:06.626063 5814 ts_tablet_manager.cc:1905] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:06.626235 5812 ts_tablet_manager.cc:1918] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:06.626294 5812 log.cc:1196] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/a268c683310f46709ec40a85fbc8c435
I20260806 00:53:06.626492 5813 ts_tablet_manager.cc:1918] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:06.626574 5813 log.cc:1196] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-0/wal/wals/a268c683310f46709ec40a85fbc8c435
I20260806 00:53:06.626582 5812 ts_tablet_manager.cc:1939] T a268c683310f46709ec40a85fbc8c435 P 7918934dde8143d2b8eff270ea63f0e1: Deleting consensus metadata
I20260806 00:53:06.626824 5813 ts_tablet_manager.cc:1939] T a268c683310f46709ec40a85fbc8c435 P 0ecf1fbe91414bf191fa76e717e53db8: Deleting consensus metadata
I20260806 00:53:06.626893 5018 catalog_manager.cc:4841] TS 7918934dde8143d2b8eff270ea63f0e1 (127.3.98.130:38801): tablet a268c683310f46709ec40a85fbc8c435 (table test-table [id=3b718aa766954b8795bee63fc6684062]) successfully deleted
I20260806 00:53:06.627207 5020 catalog_manager.cc:4841] TS 0ecf1fbe91414bf191fa76e717e53db8 (127.3.98.129:38677): tablet a268c683310f46709ec40a85fbc8c435 (table test-table [id=3b718aa766954b8795bee63fc6684062]) successfully deleted
I20260806 00:53:06.627837 5814 ts_tablet_manager.cc:1918] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:06.627894 5814 log.cc:1196] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/a268c683310f46709ec40a85fbc8c435
I20260806 00:53:06.628064 5814 ts_tablet_manager.cc:1939] T a268c683310f46709ec40a85fbc8c435 P 03c6f177c30e493f91ee134ae7705b51: Deleting consensus metadata
I20260806 00:53:06.628536 5018 catalog_manager.cc:4841] TS 03c6f177c30e493f91ee134ae7705b51 (127.3.98.131:38179): tablet a268c683310f46709ec40a85fbc8c435 (table test-table [id=3b718aa766954b8795bee63fc6684062]) successfully deleted
Aug 06 00:53:06 dist-test-slave-44d2 krb5kdc[4979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977586, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.98.129@KRBTEST.COM
I20260806 00:53:06.641397 5767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.627100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48284 (local address 127.3.98.129:38677)
0806 00:53:06.627163 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.627166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.627175 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:53:06.627199 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.627200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.627213 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.627288 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:06.632637 (+ 5349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.633184 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.634001 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.634197 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.634297 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.637758 (+ 3461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:06.637772 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:06.637773 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:06.637791 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:06.639919 (+ 2128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.640385 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.640390 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.640390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.640465 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.640724 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.640726 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.640726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.640906 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:06.641079 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.641164 (+ 85us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.641259 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260806 00:53:06.641733 5314 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48284
I20260806 00:53:06.651595 5111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:06.642877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44670 (local address 127.3.98.190:42695)
0806 00:53:06.642939 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:06.642941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:06.643206 (+ 265us) server_negotiation.cc:407] Connection header received
0806 00:53:06.643292 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:06.643293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:06.643306 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:06.643401 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:06.644056 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.644650 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.645465 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:06.645788 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:06.645853 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:06.647945 (+ 2092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:06.647947 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:06.647947 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:06.647956 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:06.650013 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.650509 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.650510 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.650511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.650582 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:06.650891 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:06.650892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:06.650893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:06.651048 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:06.651134 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:06.651401 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 00:53:06.651497 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
W20260806 00:53:06.652453 5041 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44670
I20260806 00:53:06.653366 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 5139
I20260806 00:53:06.684276 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 5332
I20260806 00:53:06.694603 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 5532
I20260806 00:53:06.707325 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 4992
2026-08-06T00:53:06Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2499 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:06 dist-test-slave-44d2 krb5kdc[5863](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:06 dist-test-slave-44d2 krb5kdc[5863](info): set up 2 sockets
Aug 06 00:53:06 dist-test-slave-44d2 krb5kdc[5863](info): commencing operation
krb5kdc: starting...
W20260806 00:53:07.922976 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:08 dist-test-slave-44d2 krb5kdc[5863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:53:08.053459 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:46509
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:46509
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:08.145684 5881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:08.145943 5881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:08.145982 5881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:08.147179 5881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:08.147251 5881 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 00:53:08.147272 5881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:08.147294 5881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:08.147326 5881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:08.147347 5881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:08.148854 5881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:46509
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:46509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:08.149144 5881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:08.149381 5881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:08.154469 5894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:08.154419 5890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:08.154527 5889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:08.154811 5881 server_base.cc:1034] running on GCE node
I20260806 00:53:08.155112 5881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:08.155421 5881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:08.156555 5881 hybrid_clock.cc:648] HybridClock initialized: now 1785977588156526 us; error 43 us; skew 500 ppm
Aug 06 00:53:08 dist-test-slave-44d2 krb5kdc[5863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977588, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:08.159309 5881 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:53:08.159765 5881 webserver.cc:460] Webserver started at http://127.3.98.190:37825/ using document root <none> and password file <none>
I20260806 00:53:08.160020 5881 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:08.160066 5881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:08.160238 5881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:08.161425 5881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "807d08871fa049cfb5eb036457a000b1"
format_stamp: "Formatted at 2026-08-06 00:53:08 on dist-test-slave-44d2"
server_key: "59190d76525940f36c309563e375d046"
server_key_iv: "13cbc5c57ce0f51f732a9ee39c8fa0f5"
server_key_version: "encryptionkey@0"
I20260806 00:53:08.161814 5881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "807d08871fa049cfb5eb036457a000b1"
format_stamp: "Formatted at 2026-08-06 00:53:08 on dist-test-slave-44d2"
server_key: "59190d76525940f36c309563e375d046"
server_key_iv: "13cbc5c57ce0f51f732a9ee39c8fa0f5"
server_key_version: "encryptionkey@0"
I20260806 00:53:08.163169 5881 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 00:53:08.163908 5905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:08.164090 5881 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:08.164183 5881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "807d08871fa049cfb5eb036457a000b1"
format_stamp: "Formatted at 2026-08-06 00:53:08 on dist-test-slave-44d2"
server_key: "59190d76525940f36c309563e375d046"
server_key_iv: "13cbc5c57ce0f51f732a9ee39c8fa0f5"
server_key_version: "encryptionkey@0"
I20260806 00:53:08.164259 5881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:08.181567 5881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:08.183490 5881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:08.183650 5881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:08.188750 5881 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:46509
I20260806 00:53:08.188817 5996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:46509 every 8 connection(s)
I20260806 00:53:08.189147 5881 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:08.189780 5997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:08.192206 5997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1: Bootstrap starting.
I20260806 00:53:08.192924 5997 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:08.193239 5997 log.cc:824] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:08.194003 5997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1: No bootstrap required, opened a new log
I20260806 00:53:08.196179 5997 raft_consensus.cc:348] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "807d08871fa049cfb5eb036457a000b1" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 46509 } }
I20260806 00:53:08.196336 5997 raft_consensus.cc:374] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:08.196362 5997 raft_consensus.cc:729] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 807d08871fa049cfb5eb036457a000b1, State: Initialized, Role: FOLLOWER
I20260806 00:53:08.196587 5997 consensus_queue.cc:260] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "807d08871fa049cfb5eb036457a000b1" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 46509 } }
I20260806 00:53:08.196660 5997 raft_consensus.cc:388] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:08.196707 5997 raft_consensus.cc:482] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:08.196878 5997 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:08.197508 5997 raft_consensus.cc:504] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "807d08871fa049cfb5eb036457a000b1" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 46509 } }
I20260806 00:53:08.197639 5997 leader_election.cc:302] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 807d08871fa049cfb5eb036457a000b1; no voters:
I20260806 00:53:08.197857 5997 leader_election.cc:288] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:08.197952 6002 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:08.198133 6002 raft_consensus.cc:686] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [term 1 LEADER]: Becoming Leader. State: Replica: 807d08871fa049cfb5eb036457a000b1, State: Running, Role: LEADER
I20260806 00:53:08.198136 5997 sys_catalog.cc:564] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:08.198240 6002 consensus_queue.cc:237] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "807d08871fa049cfb5eb036457a000b1" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 46509 } }
I20260806 00:53:08.198659 6005 sys_catalog.cc:455] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 807d08871fa049cfb5eb036457a000b1. Latest consensus state: current_term: 1 leader_uuid: "807d08871fa049cfb5eb036457a000b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "807d08871fa049cfb5eb036457a000b1" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 46509 } } }
I20260806 00:53:08.198760 6005 sys_catalog.cc:458] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:08.198653 6003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "807d08871fa049cfb5eb036457a000b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "807d08871fa049cfb5eb036457a000b1" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 46509 } } }
I20260806 00:53:08.198928 6003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:08.199061 6012 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:08.199180 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 5881
I20260806 00:53:08.199308 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:08.199486 3466 external_mini_cluster.cc:1428] Setting key 7333275c78736ad9461abf49c95ffa6c
I20260806 00:53:08.200183 6012 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:08.202080 6012 catalog_manager.cc:1347] Generated new cluster ID: 5fa524e44bc54327bfc3561b5d6eb622
I20260806 00:53:08.202136 6012 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:53:08 dist-test-slave-44d2 krb5kdc[5863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:08.211732 6020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.200117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43470 (local address 127.3.98.190:46509)
0806 00:53:08.200542 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.200551 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.200592 (+ 41us) server_negotiation.cc:407] Connection header received
0806 00:53:08.200904 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.200915 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.200981 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.201141 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:08.201840 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.203298 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.204322 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.204955 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.205042 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.207857 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:08.207861 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:08.207862 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:08.207873 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:08.209878 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.210251 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.210254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.210255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.210351 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.210515 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.210516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.210516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.210799 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:08.210903 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.211373 (+ 470us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.211501 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":83,"threads_started":1}
I20260806 00:53:08.217908 6012 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:08.218585 6012 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:08.226023 6012 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1: Generated new TSK 0
I20260806 00:53:08.226246 6012 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:53:08.264562 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:46509
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:08.349360 6030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:08.349606 6030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:08.349649 6030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:08.350806 6030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:08.350872 6030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:08.350904 6030 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 00:53:08.350934 6030 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 00:53:08.350993 6030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:08.352463 6030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.98.190:46509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:08.352821 6030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:08.353061 6030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:08.358522 6041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:08.358536 6037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:08.358839 6039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:08.358788 6030 server_base.cc:1034] running on GCE node
I20260806 00:53:08.359097 6030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:08.359313 6030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:08.360457 6030 hybrid_clock.cc:648] HybridClock initialized: now 1785977588360443 us; error 30 us; skew 500 ppm
Aug 06 00:53:08 dist-test-slave-44d2 krb5kdc[5863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977588, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:08.363165 6030 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:53:08.363704 6030 webserver.cc:460] Webserver started at http://127.3.98.129:39395/ using document root <none> and password file <none>
I20260806 00:53:08.363960 6030 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:08.364033 6030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:08.364182 6030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:08.365391 6030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "e310710f98264bccabcf04229e8d119a"
format_stamp: "Formatted at 2026-08-06 00:53:08 on dist-test-slave-44d2"
server_key: "b1e6d54c0d399bfa505a6627eb619961"
server_key_iv: "2c4b3be9ee6cc096bc56f75514aed172"
server_key_version: "encryptionkey@0"
I20260806 00:53:08.365767 6030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "e310710f98264bccabcf04229e8d119a"
format_stamp: "Formatted at 2026-08-06 00:53:08 on dist-test-slave-44d2"
server_key: "b1e6d54c0d399bfa505a6627eb619961"
server_key_iv: "2c4b3be9ee6cc096bc56f75514aed172"
server_key_version: "encryptionkey@0"
I20260806 00:53:08.367195 6030 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 00:53:08.368095 6050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:08.368278 6030 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:08.368398 6030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "e310710f98264bccabcf04229e8d119a"
format_stamp: "Formatted at 2026-08-06 00:53:08 on dist-test-slave-44d2"
server_key: "b1e6d54c0d399bfa505a6627eb619961"
server_key_iv: "2c4b3be9ee6cc096bc56f75514aed172"
server_key_version: "encryptionkey@0"
I20260806 00:53:08.368525 6030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:08.389927 6030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:08.391968 6030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:08.392149 6030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:08.392794 6030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:08.392859 6030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:08.392895 6030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:08.392925 6030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 00:53:08 dist-test-slave-44d2 krb5kdc[5863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977588, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:08.400607 6030 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:43119
I20260806 00:53:08.400722 6215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:43119 every 8 connection(s)
I20260806 00:53:08.401087 6030 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:53:08.403906 6020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.393252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:33525 (local address 127.3.98.190:46509)
0806 00:53:08.393333 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.393335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.393524 (+ 189us) server_negotiation.cc:407] Connection header received
0806 00:53:08.394027 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.394028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.394048 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.394144 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:08.394849 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.395719 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.397406 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.397796 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.397890 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.401013 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:08.401015 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:08.401015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:08.401028 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:08.402635 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.403083 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.403084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.403084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.403147 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.403366 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.403366 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.403367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.403473 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:08.403526 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.403759 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.403837 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 00:53:08.404166 6064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.393221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:46509 (local address 127.3.98.129:33525)
0806 00:53:08.393381 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:08.393421 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:08.393911 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:08.394196 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:08.394199 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:08.394437 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:08.394727 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.394734 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.395856 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.395857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.397293 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.397296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.397921 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.397922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.398354 (+ 432us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.398973 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:08.398992 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:08.400900 (+ 1908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:08.402718 (+ 1818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.402725 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.402727 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.403006 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.403208 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.403209 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.403209 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.403310 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.403529 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:08.403534 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:08.403647 (+ 113us) client_negotiation.cc:769] Sending connection context
0806 00:53:08.403730 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 00:53:08.403860 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
I20260806 00:53:08.404740 6216 heartbeater.cc:347] Connected to a master server at 127.3.98.190:46509
I20260806 00:53:08.404835 6216 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:08.405088 6216 heartbeater.cc:511] Master 127.3.98.190:46509 requested a full tablet report, sending...
I20260806 00:53:08.405731 5935 ts_manager.cc:194] Registered new tserver with Master: e310710f98264bccabcf04229e8d119a (127.3.98.129:43119)
I20260806 00:53:08.406584 5935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:33525
I20260806 00:53:08.410809 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 6030
I20260806 00:53:08.410920 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:08.411207 3466 external_mini_cluster.cc:1428] Setting key 9bccff662713b1d07a704c0dc14bb34b
I20260806 00:53:08.411689 6020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.406038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:40991 (local address 127.3.98.190:46509)
0806 00:53:08.406087 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.406089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.406226 (+ 137us) server_negotiation.cc:407] Connection header received
0806 00:53:08.406252 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.406252 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.406263 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.406331 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:08.406607 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.407199 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.407935 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.408132 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.408199 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.409065 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:08.409066 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:08.409066 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:08.409071 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:08.410525 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.410821 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.410823 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.410823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.410886 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.411125 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.411126 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.411126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.411233 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:08.411324 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.411547 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.411631 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:53:08.411707 6223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.405972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:46509 (local address 127.3.98.129:40991)
0806 00:53:08.406146 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:08.406164 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:08.406216 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:08.406333 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:08.406334 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:08.406487 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:08.406542 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.406543 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.407301 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.407302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.407838 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.407840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.408209 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.408210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.408266 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.408696 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:08.408700 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:08.408970 (+ 270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:08.410599 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.410599 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.410600 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.410750 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.410981 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.410982 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.410983 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.411060 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.411357 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:08.411373 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:08.411425 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 00:53:08.411500 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 00:53:08.411611 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":84,"threads_started":1}
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:53:08.439499 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:46509
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:08.526793 6228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:08.527144 6228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:08.527169 6228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:08.528357 6228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:08.528398 6228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:08.528419 6228 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 00:53:08.528431 6228 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 00:53:08.528482 6228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:08.529970 6228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.98.190:46509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:08.530228 6228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:08.530501 6228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:08.535776 6241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:08.535763 6242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:08.535758 6244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:08.535979 6228 server_base.cc:1034] running on GCE node
I20260806 00:53:08.536198 6228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:08.536440 6228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:08.537638 6228 hybrid_clock.cc:648] HybridClock initialized: now 1785977588537617 us; error 39 us; skew 500 ppm
Aug 06 00:53:08 dist-test-slave-44d2 krb5kdc[5863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977588, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:08.540109 6228 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:53:08.540602 6228 webserver.cc:460] Webserver started at http://127.3.98.130:43381/ using document root <none> and password file <none>
I20260806 00:53:08.540839 6228 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:08.540908 6228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:08.541070 6228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:08.542322 6228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "4b10a7a311824656b161f50c4edbb762"
format_stamp: "Formatted at 2026-08-06 00:53:08 on dist-test-slave-44d2"
server_key: "92c3dd10668d447d6af0e7f47fcdf818"
server_key_iv: "209187a1fe48fa7421a96a3c865cb899"
server_key_version: "encryptionkey@0"
I20260806 00:53:08.542771 6228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "4b10a7a311824656b161f50c4edbb762"
format_stamp: "Formatted at 2026-08-06 00:53:08 on dist-test-slave-44d2"
server_key: "92c3dd10668d447d6af0e7f47fcdf818"
server_key_iv: "209187a1fe48fa7421a96a3c865cb899"
server_key_version: "encryptionkey@0"
I20260806 00:53:08.544098 6228 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:53:08.544987 6252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:08.545181 6228 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 00:53:08.545322 6228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "4b10a7a311824656b161f50c4edbb762"
format_stamp: "Formatted at 2026-08-06 00:53:08 on dist-test-slave-44d2"
server_key: "92c3dd10668d447d6af0e7f47fcdf818"
server_key_iv: "209187a1fe48fa7421a96a3c865cb899"
server_key_version: "encryptionkey@0"
I20260806 00:53:08.545400 6228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:08.557192 6228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:08.559399 6228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:08.559587 6228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:08.560161 6228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:08.560210 6228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:08.560236 6228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:08.560292 6228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 00:53:08 dist-test-slave-44d2 krb5kdc[5863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977588, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:08.567698 6228 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:32769
I20260806 00:53:08.567776 6421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:32769 every 8 connection(s)
I20260806 00:53:08.568135 6228 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:08.570688 6020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.560758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:51285 (local address 127.3.98.190:46509)
0806 00:53:08.560826 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.560829 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.561053 (+ 224us) server_negotiation.cc:407] Connection header received
0806 00:53:08.561675 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.561676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.561694 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.561747 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:08.562680 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.563556 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.565186 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.565542 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.565626 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.567996 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:08.567998 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:08.567998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:08.568006 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:08.569494 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.569877 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.569878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.569879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.569932 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.570162 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.570163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.570163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.570267 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:08.570318 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.570554 (+ 236us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.570622 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 00:53:08.570896 6263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.560748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:46509 (local address 127.3.98.130:51285)
0806 00:53:08.560922 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:08.560960 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:08.561533 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:08.561820 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:08.561825 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:08.562239 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:08.562553 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.562560 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.563663 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.563664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.565087 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.565090 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.565628 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.565629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.565732 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.566259 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:08.566269 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:08.567885 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:08.569572 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.569580 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.569582 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.569805 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.569991 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.569992 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.569992 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.570105 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.570323 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:08.570327 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:08.570438 (+ 111us) client_negotiation.cc:769] Sending connection context
0806 00:53:08.570520 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 00:53:08.570646 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":97,"threads_started":1}
I20260806 00:53:08.571457 6422 heartbeater.cc:347] Connected to a master server at 127.3.98.190:46509
I20260806 00:53:08.571568 6422 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:08.571745 6422 heartbeater.cc:511] Master 127.3.98.190:46509 requested a full tablet report, sending...
I20260806 00:53:08.572168 5935 ts_manager.cc:194] Registered new tserver with Master: 4b10a7a311824656b161f50c4edbb762 (127.3.98.130:32769)
I20260806 00:53:08.572710 5935 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:51285
I20260806 00:53:08.575824 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 6228
I20260806 00:53:08.575934 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:08.576144 3466 external_mini_cluster.cc:1428] Setting key b8e9f73a4ca76e5740dacdde55e7d232
I20260806 00:53:08.578922 6020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.573054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:45901 (local address 127.3.98.190:46509)
0806 00:53:08.573102 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.573103 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.573566 (+ 463us) server_negotiation.cc:407] Connection header received
0806 00:53:08.573614 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.573615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.573623 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.573661 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:08.573919 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.574368 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.575061 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.575238 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.575286 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.576285 (+ 999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:08.576287 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:08.576287 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:08.576293 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:08.577726 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.578094 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.578095 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.578096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.578153 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.578368 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.578368 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.578369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.578520 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:08.578600 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.578762 (+ 162us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.578833 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 00:53:08.578931 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.572993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:46509 (local address 127.3.98.130:45901)
0806 00:53:08.573499 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:08.573509 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:08.573564 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:08.573664 (+ 100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:08.573665 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:08.573813 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:08.573867 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.573868 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.574451 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.574452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.574939 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.574940 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.575302 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.575302 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.575358 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.575737 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:08.575743 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:08.576190 (+ 447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:08.577835 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.577836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.577836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.578014 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.578231 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.578232 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.578233 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.578293 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.578595 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:08.578596 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:08.578643 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 00:53:08.578725 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 00:53:08.578833 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":86,"threads_started":1}
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:53:08.604193 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:46509
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39083
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:08.694658 6435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:08.694911 6435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:08.694940 6435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:08.696027 6435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:08.696071 6435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:08.696095 6435 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 00:53:08.696110 6435 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 00:53:08.696127 6435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:08.697600 6435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39083
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.98.190:46509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:08.697863 6435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:08.698086 6435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:08.703619 6447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:08.703538 6444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:08.703557 6445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:08.703800 6435 server_base.cc:1034] running on GCE node
I20260806 00:53:08.704005 6435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:08.704272 6435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:08.705437 6435 hybrid_clock.cc:648] HybridClock initialized: now 1785977588705420 us; error 28 us; skew 500 ppm
Aug 06 00:53:08 dist-test-slave-44d2 krb5kdc[5863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977588, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:08.707981 6435 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:53:08.708426 6435 webserver.cc:460] Webserver started at http://127.3.98.131:37915/ using document root <none> and password file <none>
I20260806 00:53:08.708680 6435 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:08.708753 6435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:08.708917 6435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:08.710084 6435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "bc4fbc2ead02493c9a7c06eb75d62539"
format_stamp: "Formatted at 2026-08-06 00:53:08 on dist-test-slave-44d2"
server_key: "c88f06105879dd1a0a8d23e6b9ec9579"
server_key_iv: "851c90f29ed479e9e83c5dce64d5eb7c"
server_key_version: "encryptionkey@0"
I20260806 00:53:08.710459 6435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "bc4fbc2ead02493c9a7c06eb75d62539"
format_stamp: "Formatted at 2026-08-06 00:53:08 on dist-test-slave-44d2"
server_key: "c88f06105879dd1a0a8d23e6b9ec9579"
server_key_iv: "851c90f29ed479e9e83c5dce64d5eb7c"
server_key_version: "encryptionkey@0"
I20260806 00:53:08.711910 6435 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:08.712941 6454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:08.713166 6435 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:08.713277 6435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "bc4fbc2ead02493c9a7c06eb75d62539"
format_stamp: "Formatted at 2026-08-06 00:53:08 on dist-test-slave-44d2"
server_key: "c88f06105879dd1a0a8d23e6b9ec9579"
server_key_iv: "851c90f29ed479e9e83c5dce64d5eb7c"
server_key_version: "encryptionkey@0"
I20260806 00:53:08.713351 6435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:08.727000 6435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:08.729655 6435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:08.729830 6435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:08.730386 6435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:08.730450 6435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:08.730494 6435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:08.730522 6435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:08.737365 6435 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:44919
I20260806 00:53:08.737439 6606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:44919 every 8 connection(s)
Aug 06 00:53:08 dist-test-slave-44d2 krb5kdc[5863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977588, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:08.737776 6435 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:08.740214 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 6435
I20260806 00:53:08.740330 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:08.740620 3466 external_mini_cluster.cc:1428] Setting key e2a52c3a7253f73020a709cc93c6bf53
I20260806 00:53:08.741115 6020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.730976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:33839 (local address 127.3.98.190:46509)
0806 00:53:08.731056 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.731059 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.731303 (+ 244us) server_negotiation.cc:407] Connection header received
0806 00:53:08.731834 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.731836 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.731851 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.731930 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:08.732833 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.733679 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.735231 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.735541 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.735647 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.738365 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:08.738366 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:08.738367 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:08.738377 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:08.739612 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.740011 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.740012 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.740013 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.740100 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.740383 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.740384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.740384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.740541 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:08.740632 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.740922 (+ 290us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.741025 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 00:53:08.741279 6469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.730946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:46509 (local address 127.3.98.131:33839)
0806 00:53:08.731167 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:08.731207 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:08.731713 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:08.732006 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:08.732011 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:08.732387 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:08.732723 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.732730 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.733780 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.733782 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.735155 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.735158 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.735657 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.735658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.735792 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.736315 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:08.736323 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:08.738284 (+ 1961us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:08.739698 (+ 1414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.739705 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.739708 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.739927 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.740169 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.740170 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.740171 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.740285 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.740623 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:08.740630 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:08.740786 (+ 156us) client_negotiation.cc:769] Sending connection context
0806 00:53:08.740897 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 00:53:08.741051 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":101,"threads_started":1}
I20260806 00:53:08.741815 6607 heartbeater.cc:347] Connected to a master server at 127.3.98.190:46509
I20260806 00:53:08.741904 6607 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:08.742089 6607 heartbeater.cc:511] Master 127.3.98.190:46509 requested a full tablet report, sending...
I20260806 00:53:08.742754 5931 ts_manager.cc:194] Registered new tserver with Master: bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131:44919)
I20260806 00:53:08.743160 5931 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:33839
I20260806 00:53:08.748764 6020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.742842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:44709 (local address 127.3.98.190:46509)
0806 00:53:08.742879 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.742880 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.743387 (+ 507us) server_negotiation.cc:407] Connection header received
0806 00:53:08.743455 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.743456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.743467 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.743521 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:08.743833 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.744292 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.745046 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.745251 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.745336 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.746136 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:08.746138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:08.746138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:08.746145 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:08.747398 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.747895 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.747896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.747897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.747957 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.748240 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.748241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.748241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.748354 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:08.748437 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.748596 (+ 159us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.748672 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260806 00:53:08.748771 6615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.742781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:46509 (local address 127.3.98.131:44709)
0806 00:53:08.743334 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:08.743346 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:08.743400 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:08.743526 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:08.743527 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:08.743704 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:08.743755 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.743756 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.744387 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.744388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.744963 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.744964 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.745339 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.745340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.745424 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.745793 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:08.745797 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:08.746049 (+ 252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:08.747610 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.747611 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.747612 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.747798 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.748031 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.748032 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.748032 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.748158 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.748430 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:08.748431 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:08.748477 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 00:53:08.748573 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 00:53:08.748675 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":71,"threads_started":1}
I20260806 00:53:08.752461 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 00:53:08 dist-test-slave-44d2 krb5kdc[5863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 00:53:08 dist-test-slave-44d2 krb5kdc[5863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977588, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:08.778913 6020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.771646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43482 (local address 127.3.98.190:46509)
0806 00:53:08.771710 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.771712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.771753 (+ 41us) server_negotiation.cc:407] Connection header received
0806 00:53:08.771784 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.771785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.771797 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.771871 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:08.772545 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.773066 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.773823 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.774043 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.774134 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.776471 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:08.776473 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:08.776473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:08.776563 (+ 90us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:08.777988 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.778299 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.778300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.778300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.778354 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.778521 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.778521 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.778522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.778622 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:08.778697 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.778781 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.778843 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 00:53:08.780766 5931 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43482:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:08.782455 5931 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:08.789425 6632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.784910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:44919 (local address 127.0.0.1:57122)
0806 00:53:08.785099 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:08.785140 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:08.785206 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:08.785996 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:08.785997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:08.785999 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:08.786047 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.786048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.786914 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.786916 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.788162 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.788165 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.789123 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.789124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.789209 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.789227 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 00:53:08.789295 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 00:53:08.789353 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":67,"threads_started":1}
I20260806 00:53:08.789587 6636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.784910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:32769 (local address 127.0.0.1:50324)
0806 00:53:08.785289 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:08.785301 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:08.785374 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:08.785733 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:08.785737 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:08.785739 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:08.785982 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.785984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.787289 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.787290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.788321 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.788323 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.789343 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.789344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.789411 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.789415 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:08.789467 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 00:53:08.789510 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":19,"thread_start_us":76,"threads_started":1}
I20260806 00:53:08.789805 6635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.785093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57122 (local address 127.3.98.131:44919)
0806 00:53:08.785844 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.785848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.785859 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:53:08.785898 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.785900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.785916 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.785986 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:08.786101 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.786812 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.788253 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.789033 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.789114 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.789176 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.789327 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.789379 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":711,"thread_start_us":83,"threads_started":1}
I20260806 00:53:08.789907 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.785020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50324 (local address 127.3.98.130:32769)
0806 00:53:08.785537 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.785540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.785549 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:53:08.785596 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.785597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.785609 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.785706 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:08.786076 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.787186 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.788397 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.789191 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.789257 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.789308 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.789755 (+ 447us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.789794 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":91,"threads_started":1}
I20260806 00:53:08.790520 6517 tablet_service.cc:1467] Processing CreateTablet for tablet 78e3739726cc40d5911a6b21d7118909 (DEFAULT_TABLE table=test-table [id=b8d90cb256004f5ba33fb988c22052e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:08.790613 6324 tablet_service.cc:1467] Processing CreateTablet for tablet 78e3739726cc40d5911a6b21d7118909 (DEFAULT_TABLE table=test-table [id=b8d90cb256004f5ba33fb988c22052e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:08.790916 6517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78e3739726cc40d5911a6b21d7118909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:08.791013 6324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78e3739726cc40d5911a6b21d7118909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:08.793154 6633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.785143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:43119 (local address 127.0.0.1:57888)
0806 00:53:08.785294 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:08.785303 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:08.785345 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:08.785733 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:08.785737 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:08.785740 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:08.785889 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.785891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.788395 (+ 2504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.788395 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.789150 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.789152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.792885 (+ 3733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.792887 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.792966 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.792971 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:53:08.793033 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 00:53:08.793078 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":17,"thread_start_us":99,"threads_started":1}
I20260806 00:53:08.793222 6637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.785303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57888 (local address 127.3.98.129:43119)
0806 00:53:08.785506 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.785510 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.785518 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:53:08.785552 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.785553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.785587 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.785666 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:08.785983 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.787186 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.789252 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.792707 (+ 3455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.792779 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.792846 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.793074 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.793121 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":95,"threads_started":1}
I20260806 00:53:08.793923 6638 tablet_bootstrap.cc:492] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539: Bootstrap starting.
I20260806 00:53:08.794368 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 78e3739726cc40d5911a6b21d7118909 (DEFAULT_TABLE table=test-table [id=b8d90cb256004f5ba33fb988c22052e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:08.794509 6639 tablet_bootstrap.cc:492] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762: Bootstrap starting.
I20260806 00:53:08.794776 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78e3739726cc40d5911a6b21d7118909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:08.794976 6638 tablet_bootstrap.cc:654] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:08.795305 6639 tablet_bootstrap.cc:654] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:08.795338 6638 log.cc:824] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:08.795677 6639 log.cc:824] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:08.796447 6638 tablet_bootstrap.cc:492] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539: No bootstrap required, opened a new log
I20260806 00:53:08.796595 6638 ts_tablet_manager.cc:1397] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 00:53:08.796648 6639 tablet_bootstrap.cc:492] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762: No bootstrap required, opened a new log
I20260806 00:53:08.796717 6639 ts_tablet_manager.cc:1397] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:53:08.797988 6638 raft_consensus.cc:348] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.798141 6638 raft_consensus.cc:374] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:08.798182 6638 raft_consensus.cc:729] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc4fbc2ead02493c9a7c06eb75d62539, State: Initialized, Role: FOLLOWER
I20260806 00:53:08.798334 6638 consensus_queue.cc:260] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.798686 6607 heartbeater.cc:503] Master 127.3.98.190:46509 was elected leader, sending a full tablet report...
I20260806 00:53:08.798687 6638 ts_tablet_manager.cc:1428] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 00:53:08.799001 6639 raft_consensus.cc:348] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.799188 6639 raft_consensus.cc:374] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:08.799232 6639 raft_consensus.cc:729] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b10a7a311824656b161f50c4edbb762, State: Initialized, Role: FOLLOWER
I20260806 00:53:08.799343 6639 consensus_queue.cc:260] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.799623 6639 ts_tablet_manager.cc:1428] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:53:08.799757 6422 heartbeater.cc:503] Master 127.3.98.190:46509 was elected leader, sending a full tablet report...
I20260806 00:53:08.799841 6644 tablet_bootstrap.cc:492] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a: Bootstrap starting.
I20260806 00:53:08.800706 6644 tablet_bootstrap.cc:654] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:08.801038 6644 log.cc:824] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:08.801820 6644 tablet_bootstrap.cc:492] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a: No bootstrap required, opened a new log
I20260806 00:53:08.801887 6644 ts_tablet_manager.cc:1397] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:53:08.803206 6644 raft_consensus.cc:348] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.803324 6644 raft_consensus.cc:374] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:08.803346 6644 raft_consensus.cc:729] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e310710f98264bccabcf04229e8d119a, State: Initialized, Role: FOLLOWER
I20260806 00:53:08.803465 6644 consensus_queue.cc:260] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.803740 6644 ts_tablet_manager.cc:1428] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:53:08.803771 6216 heartbeater.cc:503] Master 127.3.98.190:46509 was elected leader, sending a full tablet report...
W20260806 00:53:08.819188 6423 tablet.cc:2369] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:53:08.886929 6643 raft_consensus.cc:482] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:08.887076 6643 raft_consensus.cc:504] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.887456 6643 leader_election.cc:288] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b10a7a311824656b161f50c4edbb762 (127.3.98.130:32769), e310710f98264bccabcf04229e8d119a (127.3.98.129:43119)
I20260806 00:53:08.890686 6648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.887842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:43119 (local address 127.3.98.131:48915)
0806 00:53:08.888039 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:08.888049 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:08.888123 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:08.888256 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:08.888257 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:08.888259 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:08.888331 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.888332 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.889051 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.889052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.889854 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.889856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.890409 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.890410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.890491 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.890495 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:08.890538 (+ 43us) client_negotiation.cc:240] Negotiation successful
0806 00:53:08.890570 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":127,"threads_started":1}
I20260806 00:53:08.890687 6637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.887943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:48915 (local address 127.3.98.129:43119)
0806 00:53:08.887999 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.888001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.888119 (+ 118us) server_negotiation.cc:407] Connection header received
0806 00:53:08.888172 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.888173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.888187 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.888241 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:08.888404 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.888938 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.889963 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.890328 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.890385 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.890416 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.890566 (+ 150us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.890620 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 00:53:08.890769 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.887811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:58661 (local address 127.3.98.130:32769)
0806 00:53:08.887861 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.887864 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.887874 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:08.887940 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.887941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.887995 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.888054 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:08.888256 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.888881 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.889997 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.890339 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.890429 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.890437 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.890642 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.890688 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 00:53:08.890800 6469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.887717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:32769 (local address 127.3.98.131:58661)
0806 00:53:08.887784 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:08.887800 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:08.887868 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:08.888057 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:08.888059 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:08.888060 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:08.888145 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.888146 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.888965 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.888966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.889865 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.889868 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.890450 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.890459 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.890554 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.890558 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:08.890616 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 00:53:08.890654 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":56}
I20260806 00:53:08.891304 6348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e3739726cc40d5911a6b21d7118909" candidate_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b10a7a311824656b161f50c4edbb762" is_pre_election: true
I20260806 00:53:08.891325 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e3739726cc40d5911a6b21d7118909" candidate_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e310710f98264bccabcf04229e8d119a" is_pre_election: true
I20260806 00:53:08.891484 6154 raft_consensus.cc:2454] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc4fbc2ead02493c9a7c06eb75d62539 in term 0.
I20260806 00:53:08.891474 6348 raft_consensus.cc:2454] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc4fbc2ead02493c9a7c06eb75d62539 in term 0.
I20260806 00:53:08.891708 6456 leader_election.cc:302] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc4fbc2ead02493c9a7c06eb75d62539, e310710f98264bccabcf04229e8d119a; no voters:
I20260806 00:53:08.891880 6643 raft_consensus.cc:2781] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:08.891957 6643 raft_consensus.cc:482] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:08.891978 6643 raft_consensus.cc:3037] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:08.892763 6643 raft_consensus.cc:504] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.892902 6643 leader_election.cc:288] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [CANDIDATE]: Term 1 election: Requested vote from peers 4b10a7a311824656b161f50c4edbb762 (127.3.98.130:32769), e310710f98264bccabcf04229e8d119a (127.3.98.129:43119)
I20260806 00:53:08.893076 6348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e3739726cc40d5911a6b21d7118909" candidate_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b10a7a311824656b161f50c4edbb762"
I20260806 00:53:08.893123 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78e3739726cc40d5911a6b21d7118909" candidate_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e310710f98264bccabcf04229e8d119a"
I20260806 00:53:08.893177 6348 raft_consensus.cc:3037] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:08.893229 6154 raft_consensus.cc:3037] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:08.893884 6348 raft_consensus.cc:2454] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc4fbc2ead02493c9a7c06eb75d62539 in term 1.
I20260806 00:53:08.893951 6154 raft_consensus.cc:2454] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc4fbc2ead02493c9a7c06eb75d62539 in term 1.
I20260806 00:53:08.894078 6456 leader_election.cc:302] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b10a7a311824656b161f50c4edbb762, bc4fbc2ead02493c9a7c06eb75d62539; no voters:
I20260806 00:53:08.894176 6643 raft_consensus.cc:2781] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:08.894342 6643 raft_consensus.cc:686] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 LEADER]: Becoming Leader. State: Replica: bc4fbc2ead02493c9a7c06eb75d62539, State: Running, Role: LEADER
I20260806 00:53:08.894439 6643 consensus_queue.cc:237] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.895296 5935 catalog_manager.cc:5495] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131). New cstate: current_term: 1 leader_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } health_report { overall_health: HEALTHY } } }
W20260806 00:53:08.901916 6217 tablet.cc:2369] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 00:53:08 dist-test-slave-44d2 krb5kdc[5863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977588, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:08.936480 6656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.929276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:46509 (local address 127.0.0.1:43484)
0806 00:53:08.929458 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:08.929477 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:08.929584 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:08.929739 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:08.929740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:08.930108 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:08.930162 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.930165 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.930848 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.930850 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.931385 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:08.931387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.931750 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.931751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:08.931806 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.932368 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:08.932373 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:08.933881 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:08.935314 (+ 1433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.935323 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.935326 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.935525 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.935763 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:08.935764 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:08.935764 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:08.935828 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:08.936072 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:08.936082 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:08.936132 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 00:53:08.936221 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 00:53:08.936355 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":83,"threads_started":1}
I20260806 00:53:08.936547 6020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:08.929348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43484 (local address 127.3.98.190:46509)
0806 00:53:08.929413 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:08.929416 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:08.929549 (+ 133us) server_negotiation.cc:407] Connection header received
0806 00:53:08.929652 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:08.929653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:08.929671 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:08.929733 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:08.930260 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.930753 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.931475 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:08.931661 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:08.931750 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:08.933970 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:08.933971 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:08.933972 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:08.933979 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:08.935213 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.935631 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.935632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.935633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.935693 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:08.935893 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:08.935894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:08.935894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:08.936005 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:08.936092 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:08.936244 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 00:53:08.936412 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":96,"server-negotiator.queue_time_us":33}
I20260806 00:53:08.938532 5935 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:43484:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 00:53:08.938803 5935 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:08.940506 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 999fcd9376634811adde1e8b639db845 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bce406ebb0a444ab87b6f3cbd8fdb670]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 00:53:08.940500 6517 tablet_service.cc:1467] Processing CreateTablet for tablet 999fcd9376634811adde1e8b639db845 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bce406ebb0a444ab87b6f3cbd8fdb670]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 00:53:08.940537 6324 tablet_service.cc:1467] Processing CreateTablet for tablet 999fcd9376634811adde1e8b639db845 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=bce406ebb0a444ab87b6f3cbd8fdb670]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 00:53:08.940689 6517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 999fcd9376634811adde1e8b639db845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:08.940689 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 999fcd9376634811adde1e8b639db845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:08.940757 6324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 999fcd9376634811adde1e8b639db845. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:08.942270 6639 tablet_bootstrap.cc:492] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762: Bootstrap starting.
I20260806 00:53:08.942508 6644 tablet_bootstrap.cc:492] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a: Bootstrap starting.
I20260806 00:53:08.942816 6638 tablet_bootstrap.cc:492] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539: Bootstrap starting.
I20260806 00:53:08.942996 6639 tablet_bootstrap.cc:654] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:08.942991 6644 tablet_bootstrap.cc:654] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:08.943224 6638 tablet_bootstrap.cc:654] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:08.943773 6644 tablet_bootstrap.cc:492] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a: No bootstrap required, opened a new log
I20260806 00:53:08.943789 6639 tablet_bootstrap.cc:492] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762: No bootstrap required, opened a new log
I20260806 00:53:08.943835 6644 ts_tablet_manager.cc:1397] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:08.943835 6639 ts_tablet_manager.cc:1397] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:53:08.943995 6644 raft_consensus.cc:348] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.943995 6639 raft_consensus.cc:348] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.944074 6644 raft_consensus.cc:374] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:08.944083 6639 raft_consensus.cc:374] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:08.944101 6644 raft_consensus.cc:729] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e310710f98264bccabcf04229e8d119a, State: Initialized, Role: FOLLOWER
I20260806 00:53:08.944108 6639 raft_consensus.cc:729] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b10a7a311824656b161f50c4edbb762, State: Initialized, Role: FOLLOWER
I20260806 00:53:08.944154 6639 consensus_queue.cc:260] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.944159 6644 consensus_queue.cc:260] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.944258 6639 ts_tablet_manager.cc:1428] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:08.944273 6644 ts_tablet_manager.cc:1428] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:08.944314 6647 tablet_replica.cc:439] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } } }
I20260806 00:53:08.944422 6647 tablet_replica.cc:442] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:08.944602 6645 tablet_replica.cc:439] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } } }
I20260806 00:53:08.944696 6645 tablet_replica.cc:442] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:08.945088 6638 tablet_bootstrap.cc:492] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539: No bootstrap required, opened a new log
I20260806 00:53:08.945152 6638 ts_tablet_manager.cc:1397] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 00:53:08.945307 6638 raft_consensus.cc:348] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.945379 6638 raft_consensus.cc:374] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:08.945400 6638 raft_consensus.cc:729] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc4fbc2ead02493c9a7c06eb75d62539, State: Initialized, Role: FOLLOWER
I20260806 00:53:08.945453 6638 consensus_queue.cc:260] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:08.945549 6638 ts_tablet_manager.cc:1428] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:08.945624 6643 tablet_replica.cc:439] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } } }
I20260806 00:53:08.945736 6643 tablet_replica.cc:442] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539: This TxnStatusTablet replica's current role is: FOLLOWER
W20260806 00:53:08.988714 6609 tablet.cc:2369] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:53:09.106043 6645 raft_consensus.cc:482] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:09.106201 6645 raft_consensus.cc:504] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:09.106624 6645 leader_election.cc:288] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e310710f98264bccabcf04229e8d119a (127.3.98.129:43119), bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131:44919)
I20260806 00:53:09.109658 6635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.106950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:43621 (local address 127.3.98.131:44919)
0806 00:53:09.106996 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:09.106999 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:09.107108 (+ 109us) server_negotiation.cc:407] Connection header received
0806 00:53:09.107185 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:09.107186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:09.107198 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:09.107251 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:09.107416 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.107895 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.108916 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.109291 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.109385 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.109401 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:09.109542 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 00:53:09.109584 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 00:53:09.109683 6637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.106901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:44423 (local address 127.3.98.129:43119)
0806 00:53:09.107034 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:09.107036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:09.107047 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:53:09.107120 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:09.107121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:09.107139 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:09.107207 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:09.107373 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.107866 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.108888 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.109262 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.109350 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.109360 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:09.109573 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 00:53:09.109610 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260806 00:53:09.109705 6662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.106824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:44919 (local address 127.3.98.130:43621)
0806 00:53:09.107019 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:09.107029 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:09.107127 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:09.107253 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:09.107253 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:09.107255 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:09.107336 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:09.107338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.107991 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.107992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:09.108829 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:09.108831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.109388 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.109389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:09.109462 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.109467 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:53:09.109537 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 00:53:09.109579 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":35,"thread_start_us":59,"threads_started":1}
I20260806 00:53:09.109712 6661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.106823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:43119 (local address 127.3.98.130:44423)
0806 00:53:09.106965 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:09.106979 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:09.107043 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:09.107214 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:09.107215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:09.107217 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:09.107289 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:09.107291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.107977 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.107978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:09.108783 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:09.108785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.109360 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.109361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:09.109446 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.109450 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:09.109561 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 00:53:09.109609 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":3,"thread_start_us":149,"threads_started":1}
I20260806 00:53:09.110270 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999fcd9376634811adde1e8b639db845" candidate_uuid: "4b10a7a311824656b161f50c4edbb762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e310710f98264bccabcf04229e8d119a" is_pre_election: true
I20260806 00:53:09.110265 6544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999fcd9376634811adde1e8b639db845" candidate_uuid: "4b10a7a311824656b161f50c4edbb762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" is_pre_election: true
I20260806 00:53:09.110363 6154 raft_consensus.cc:2454] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b10a7a311824656b161f50c4edbb762 in term 0.
I20260806 00:53:09.110411 6544 raft_consensus.cc:2454] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b10a7a311824656b161f50c4edbb762 in term 0.
I20260806 00:53:09.110536 6254 leader_election.cc:302] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b10a7a311824656b161f50c4edbb762, e310710f98264bccabcf04229e8d119a; no voters:
I20260806 00:53:09.110675 6645 raft_consensus.cc:2781] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:09.110714 6645 raft_consensus.cc:482] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:09.110729 6645 raft_consensus.cc:3037] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:09.111442 6645 raft_consensus.cc:504] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:09.111588 6645 leader_election.cc:288] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [CANDIDATE]: Term 1 election: Requested vote from peers e310710f98264bccabcf04229e8d119a (127.3.98.129:43119), bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131:44919)
I20260806 00:53:09.111726 6544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999fcd9376634811adde1e8b639db845" candidate_uuid: "4b10a7a311824656b161f50c4edbb762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc4fbc2ead02493c9a7c06eb75d62539"
I20260806 00:53:09.111745 6154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "999fcd9376634811adde1e8b639db845" candidate_uuid: "4b10a7a311824656b161f50c4edbb762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e310710f98264bccabcf04229e8d119a"
I20260806 00:53:09.111822 6154 raft_consensus.cc:3037] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:09.111824 6544 raft_consensus.cc:3037] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:09.112453 6154 raft_consensus.cc:2454] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b10a7a311824656b161f50c4edbb762 in term 1.
I20260806 00:53:09.112617 6544 raft_consensus.cc:2454] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b10a7a311824656b161f50c4edbb762 in term 1.
I20260806 00:53:09.112681 6254 leader_election.cc:302] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b10a7a311824656b161f50c4edbb762, e310710f98264bccabcf04229e8d119a; no voters:
I20260806 00:53:09.112778 6645 raft_consensus.cc:2781] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:09.112897 6645 raft_consensus.cc:686] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [term 1 LEADER]: Becoming Leader. State: Replica: 4b10a7a311824656b161f50c4edbb762, State: Running, Role: LEADER
I20260806 00:53:09.112982 6645 consensus_queue.cc:237] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:09.113476 6663 tablet_replica.cc:439] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762: TxnStatusTablet state changed. Reason: New leader 4b10a7a311824656b161f50c4edbb762. Latest consensus state: current_term: 1 leader_uuid: "4b10a7a311824656b161f50c4edbb762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } } }
I20260806 00:53:09.113564 6663 tablet_replica.cc:442] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762: This TxnStatusTablet replica's current role is: LEADER
I20260806 00:53:09.113787 6667 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 00:53:09.113759 5931 catalog_manager.cc:5495] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b10a7a311824656b161f50c4edbb762 (127.3.98.130). New cstate: current_term: 1 leader_uuid: "4b10a7a311824656b161f50c4edbb762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } health_report { overall_health: UNKNOWN } } }
I20260806 00:53:09.113909 6667 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 00:53:09.127841 6656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.125007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:32769 (local address 127.0.0.1:50330)
0806 00:53:09.125156 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:09.125168 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:09.125246 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:09.125471 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:09.125473 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:09.125474 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 00:53:09.125527 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:09.125529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.126187 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.126188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:09.126878 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:09.126881 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.127312 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.127312 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:09.127361 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.127375 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 00:53:09.127663 (+ 288us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 00:53:09.127674 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 00:53:09.127723 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 00:53:09.127771 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260806 00:53:09.127832 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.125049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50330 (local address 127.3.98.130:32769)
0806 00:53:09.125095 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:09.125097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:09.125225 (+ 128us) server_negotiation.cc:407] Connection header received
0806 00:53:09.125319 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:09.125320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:09.125340 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:09.125460 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:09.125596 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.126094 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.126988 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.127222 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.127256 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.127472 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:09.127591 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:09.127687 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:09.127730 (+ 43us) server_negotiation.cc:299] Negotiation successful
0806 00:53:09.127753 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:53:09.129938 6154 raft_consensus.cc:1261] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Refusing update from remote peer 4b10a7a311824656b161f50c4edbb762: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:09.129938 6544 raft_consensus.cc:1261] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Refusing update from remote peer 4b10a7a311824656b161f50c4edbb762: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:09.130254 6645 consensus_queue.cc:1035] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:09.130365 6663 consensus_queue.cc:1035] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:09.131641 6647 tablet_replica.cc:439] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a: TxnStatusTablet state changed. Reason: New leader 4b10a7a311824656b161f50c4edbb762. Latest consensus state: current_term: 1 leader_uuid: "4b10a7a311824656b161f50c4edbb762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } } }
I20260806 00:53:09.131738 6647 tablet_replica.cc:442] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:09.131675 6643 tablet_replica.cc:439] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539: TxnStatusTablet state changed. Reason: New leader 4b10a7a311824656b161f50c4edbb762. Latest consensus state: current_term: 1 leader_uuid: "4b10a7a311824656b161f50c4edbb762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } } }
I20260806 00:53:09.131773 6643 tablet_replica.cc:442] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:09.132566 6663 tablet_replica.cc:439] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4b10a7a311824656b161f50c4edbb762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } } }
I20260806 00:53:09.132680 6663 tablet_replica.cc:442] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762: This TxnStatusTablet replica's current role is: LEADER
I20260806 00:53:09.132823 6671 mvcc.cc:205] Tried to move back new op lower bound from 7315364205073256448 to 7315364205007237120. Current Snapshot: MvccSnapshot[applied={T|T < 7315364205073256448}]
I20260806 00:53:09.133028 6643 tablet_replica.cc:439] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4b10a7a311824656b161f50c4edbb762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } } }
I20260806 00:53:09.133121 6643 tablet_replica.cc:442] T 999fcd9376634811adde1e8b639db845 P bc4fbc2ead02493c9a7c06eb75d62539: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:09.133607 6673 mvcc.cc:205] Tried to move back new op lower bound from 7315364205073256448 to 7315364205007237120. Current Snapshot: MvccSnapshot[applied={T|T < 7315364205073256448}]
I20260806 00:53:09.133718 6663 tablet_replica.cc:439] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4b10a7a311824656b161f50c4edbb762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } } }
I20260806 00:53:09.133807 6663 tablet_replica.cc:442] T 999fcd9376634811adde1e8b639db845 P 4b10a7a311824656b161f50c4edbb762: This TxnStatusTablet replica's current role is: LEADER
I20260806 00:53:09.134056 6647 tablet_replica.cc:439] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4b10a7a311824656b161f50c4edbb762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } } }
I20260806 00:53:09.134164 6647 tablet_replica.cc:442] T 999fcd9376634811adde1e8b639db845 P e310710f98264bccabcf04229e8d119a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:09.134299 6672 mvcc.cc:205] Tried to move back new op lower bound from 7315364205073256448 to 7315364205007237120. Current Snapshot: MvccSnapshot[applied={T|T < 7315364205073256448}]
I20260806 00:53:09.138881 6635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.136176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57126 (local address 127.3.98.131:44919)
0806 00:53:09.136217 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:09.136219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:09.136229 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:09.136270 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:09.136271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:09.136285 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:09.136341 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:09.136522 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.136988 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.138130 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.138317 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.138379 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.138548 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:09.138654 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:09.138711 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:09.138777 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 00:53:09.138797 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 00:53:09.143862 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.141538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:54629 (local address 127.3.98.130:32769)
0806 00:53:09.141604 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:09.141606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:09.141615 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:53:09.141696 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:09.141696 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:09.141713 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:09.141776 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:09.141917 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.142384 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.143155 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.143351 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.143429 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.143628 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:09.143662 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:09.143722 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:09.143775 (+ 53us) server_negotiation.cc:299] Negotiation successful
0806 00:53:09.143796 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 00:53:09.143890 6615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.141451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:32769 (local address 127.3.98.131:54629)
0806 00:53:09.141530 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:09.141546 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:09.141610 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:09.141779 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:09.141779 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:09.141781 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 00:53:09.141839 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:09.141840 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.142467 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.142468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:09.143052 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:09.143054 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.143429 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.143430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:09.143505 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.143518 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 00:53:09.143726 (+ 208us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 00:53:09.143728 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:53:09.143775 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 00:53:09.143819 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260806 00:53:09.146869 6154 raft_consensus.cc:1261] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Refusing update from remote peer bc4fbc2ead02493c9a7c06eb75d62539: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:09.146978 6348 raft_consensus.cc:1261] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Refusing update from remote peer bc4fbc2ead02493c9a7c06eb75d62539: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:09.147142 6649 consensus_queue.cc:1035] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:09.147488 6649 consensus_queue.cc:1035] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:09.157660 6635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.154859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:57601 (local address 127.3.98.131:44919)
0806 00:53:09.154919 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:09.154921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:09.155066 (+ 145us) server_negotiation.cc:407] Connection header received
0806 00:53:09.155136 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:09.155137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:09.155151 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:09.155202 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:09.155349 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.155803 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.156997 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.157191 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.157246 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.157456 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:09.157481 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:09.157514 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:09.157584 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 00:53:09.157601 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 00:53:09.157727 6692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.154765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:44919 (local address 127.3.98.130:57601)
0806 00:53:09.154997 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:09.155008 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:09.155073 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:09.155211 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:09.155212 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:09.155225 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 00:53:09.155288 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:09.155290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.155877 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.155878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:09.156911 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:09.156915 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.157283 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.157284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:09.157350 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.157368 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 00:53:09.157535 (+ 167us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 00:53:09.157537 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:53:09.157577 (+ 40us) client_negotiation.cc:240] Negotiation successful
0806 00:53:09.157624 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":115,"threads_started":1}
I20260806 00:53:09.167701 5935 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:09.167821 5935 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:09.168630 5935 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1: Sending DeleteTablet for 3 replicas of tablet 78e3739726cc40d5911a6b21d7118909
I20260806 00:53:09.169020 6324 tablet_service.cc:1514] Processing DeleteTablet for tablet 78e3739726cc40d5911a6b21d7118909 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:09 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:50324
I20260806 00:53:09.169054 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 78e3739726cc40d5911a6b21d7118909 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:09 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:57888
I20260806 00:53:09.169406 6696 tablet_replica.cc:330] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762: stopping tablet replica
I20260806 00:53:09.169546 6697 tablet_replica.cc:330] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a: stopping tablet replica
I20260806 00:53:09.169610 5935 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43482:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:09.169759 5935 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:09.169996 6697 raft_consensus.cc:2229] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:09.169714 6696 raft_consensus.cc:2229] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:09.170228 6696 raft_consensus.cc:2258] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:09.170240 6517 tablet_service.cc:1514] Processing DeleteTablet for tablet 78e3739726cc40d5911a6b21d7118909 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:09 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:57122
I20260806 00:53:09.170379 6697 raft_consensus.cc:2258] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:09.170928 6697 ts_tablet_manager.cc:1905] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:09.171283 6324 tablet_service.cc:1467] Processing CreateTablet for tablet 515980ff76084d0cbacb9a69ff605649 (DEFAULT_TABLE table=test-table [id=3af4bf8c2a4f455da9bdf854e941ee4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:09.171435 6324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 515980ff76084d0cbacb9a69ff605649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:09.171617 6696 ts_tablet_manager.cc:1905] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:09.172904 6639 tablet_bootstrap.cc:492] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762: Bootstrap starting.
I20260806 00:53:09.173291 6697 ts_tablet_manager.cc:1918] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:09.173308 6639 tablet_bootstrap.cc:654] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:09.173440 6697 log.cc:1196] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/wal/wals/78e3739726cc40d5911a6b21d7118909
I20260806 00:53:09.173780 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 515980ff76084d0cbacb9a69ff605649 (DEFAULT_TABLE table=test-table [id=3af4bf8c2a4f455da9bdf854e941ee4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:09.173895 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 515980ff76084d0cbacb9a69ff605649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:09.174341 6517 tablet_service.cc:1467] Processing CreateTablet for tablet 515980ff76084d0cbacb9a69ff605649 (DEFAULT_TABLE table=test-table [id=3af4bf8c2a4f455da9bdf854e941ee4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:09.174465 6517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 515980ff76084d0cbacb9a69ff605649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:09.175130 6644 tablet_bootstrap.cc:492] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a: Bootstrap starting.
I20260806 00:53:09.175509 6644 tablet_bootstrap.cc:654] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:09.175848 6638 tablet_bootstrap.cc:492] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539: Bootstrap starting.
I20260806 00:53:09.173825 6697 ts_tablet_manager.cc:1939] T 78e3739726cc40d5911a6b21d7118909 P e310710f98264bccabcf04229e8d119a: Deleting consensus metadata
I20260806 00:53:09.176237 6638 tablet_bootstrap.cc:654] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:09.176545 5907 catalog_manager.cc:4841] TS e310710f98264bccabcf04229e8d119a (127.3.98.129:43119): tablet 78e3739726cc40d5911a6b21d7118909 (table test-table [id=b8d90cb256004f5ba33fb988c22052e8]) successfully deleted
I20260806 00:53:09.177040 6644 tablet_bootstrap.cc:492] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a: No bootstrap required, opened a new log
I20260806 00:53:09.177091 6644 ts_tablet_manager.cc:1397] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:53:09.177156 6638 tablet_bootstrap.cc:492] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539: No bootstrap required, opened a new log
I20260806 00:53:09.177198 6638 ts_tablet_manager.cc:1397] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:09.177222 6644 raft_consensus.cc:348] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:09.177284 6644 raft_consensus.cc:374] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:09.177304 6644 raft_consensus.cc:729] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e310710f98264bccabcf04229e8d119a, State: Initialized, Role: FOLLOWER
I20260806 00:53:09.177351 6644 consensus_queue.cc:260] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:09.177330 6638 raft_consensus.cc:348] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:09.177410 6638 raft_consensus.cc:374] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:09.177431 6638 raft_consensus.cc:729] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc4fbc2ead02493c9a7c06eb75d62539, State: Initialized, Role: FOLLOWER
I20260806 00:53:09.177448 6644 ts_tablet_manager.cc:1428] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:09.177480 6638 consensus_queue.cc:260] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:09.177559 6638 ts_tablet_manager.cc:1428] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:09.180912 6639 tablet_bootstrap.cc:492] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762: No bootstrap required, opened a new log
I20260806 00:53:09.180971 6639 ts_tablet_manager.cc:1397] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260806 00:53:09.181118 6639 raft_consensus.cc:348] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:09.181186 6639 raft_consensus.cc:374] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:09.181203 6639 raft_consensus.cc:729] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b10a7a311824656b161f50c4edbb762, State: Initialized, Role: FOLLOWER
I20260806 00:53:09.181241 6639 consensus_queue.cc:260] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:09.181314 6639 ts_tablet_manager.cc:1428] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:09.182005 6696 ts_tablet_manager.cc:1918] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:09.182133 6696 log.cc:1196] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/78e3739726cc40d5911a6b21d7118909
I20260806 00:53:09.182451 6696 ts_tablet_manager.cc:1939] T 78e3739726cc40d5911a6b21d7118909 P 4b10a7a311824656b161f50c4edbb762: Deleting consensus metadata
I20260806 00:53:09.182859 5907 catalog_manager.cc:4841] TS 4b10a7a311824656b161f50c4edbb762 (127.3.98.130:32769): tablet 78e3739726cc40d5911a6b21d7118909 (table test-table [id=b8d90cb256004f5ba33fb988c22052e8]) successfully deleted
I20260806 00:53:09.183023 6699 tablet_replica.cc:330] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539: stopping tablet replica
I20260806 00:53:09.183133 6699 raft_consensus.cc:2229] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:53:09.183239 6699 raft_consensus.cc:2258] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:09.183615 6699 ts_tablet_manager.cc:1905] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:09.185185 6699 ts_tablet_manager.cc:1918] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:09.185262 6699 log.cc:1196] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/78e3739726cc40d5911a6b21d7118909
I20260806 00:53:09.185509 6699 ts_tablet_manager.cc:1939] T 78e3739726cc40d5911a6b21d7118909 P bc4fbc2ead02493c9a7c06eb75d62539: Deleting consensus metadata
I20260806 00:53:09.185928 5906 catalog_manager.cc:4841] TS bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131:44919): tablet 78e3739726cc40d5911a6b21d7118909 (table test-table [id=b8d90cb256004f5ba33fb988c22052e8]) successfully deleted
I20260806 00:53:09.248409 6694 raft_consensus.cc:482] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:09.248585 6694 raft_consensus.cc:504] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:09.248797 6694 leader_election.cc:288] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e310710f98264bccabcf04229e8d119a (127.3.98.129:43119), bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131:44919)
I20260806 00:53:09.249042 6544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "515980ff76084d0cbacb9a69ff605649" candidate_uuid: "4b10a7a311824656b161f50c4edbb762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" is_pre_election: true
I20260806 00:53:09.249158 6544 raft_consensus.cc:2454] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b10a7a311824656b161f50c4edbb762 in term 0.
I20260806 00:53:09.249140 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "515980ff76084d0cbacb9a69ff605649" candidate_uuid: "4b10a7a311824656b161f50c4edbb762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e310710f98264bccabcf04229e8d119a" is_pre_election: true
I20260806 00:53:09.249254 6153 raft_consensus.cc:2454] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b10a7a311824656b161f50c4edbb762 in term 0.
I20260806 00:53:09.249379 6253 leader_election.cc:302] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b10a7a311824656b161f50c4edbb762, bc4fbc2ead02493c9a7c06eb75d62539; no voters:
I20260806 00:53:09.249482 6694 raft_consensus.cc:2781] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:09.249512 6694 raft_consensus.cc:482] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:09.249532 6694 raft_consensus.cc:3037] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:09.250524 6694 raft_consensus.cc:504] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:09.250824 6544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "515980ff76084d0cbacb9a69ff605649" candidate_uuid: "4b10a7a311824656b161f50c4edbb762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc4fbc2ead02493c9a7c06eb75d62539"
I20260806 00:53:09.250892 6544 raft_consensus.cc:3037] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:09.250841 6153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "515980ff76084d0cbacb9a69ff605649" candidate_uuid: "4b10a7a311824656b161f50c4edbb762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e310710f98264bccabcf04229e8d119a"
I20260806 00:53:09.250931 6153 raft_consensus.cc:3037] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:09.251713 6544 raft_consensus.cc:2454] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b10a7a311824656b161f50c4edbb762 in term 1.
I20260806 00:53:09.251875 6153 raft_consensus.cc:2454] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b10a7a311824656b161f50c4edbb762 in term 1.
I20260806 00:53:09.251879 6253 leader_election.cc:302] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b10a7a311824656b161f50c4edbb762, bc4fbc2ead02493c9a7c06eb75d62539; no voters:
I20260806 00:53:09.251966 6663 raft_consensus.cc:2781] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:09.252008 6663 raft_consensus.cc:686] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [term 1 LEADER]: Becoming Leader. State: Replica: 4b10a7a311824656b161f50c4edbb762, State: Running, Role: LEADER
I20260806 00:53:09.252053 6663 consensus_queue.cc:237] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:09.252475 6694 leader_election.cc:288] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [CANDIDATE]: Term 1 election: Requested vote from peers e310710f98264bccabcf04229e8d119a (127.3.98.129:43119), bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131:44919)
I20260806 00:53:09.252741 5935 catalog_manager.cc:5495] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b10a7a311824656b161f50c4edbb762 (127.3.98.130). New cstate: current_term: 1 leader_uuid: "4b10a7a311824656b161f50c4edbb762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } health_report { overall_health: UNKNOWN } } }
I20260806 00:53:09.278733 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.276148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50346 (local address 127.3.98.130:32769)
0806 00:53:09.276198 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:09.276200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:09.276206 (+ 6us) server_negotiation.cc:407] Connection header received
0806 00:53:09.276226 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:09.276227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:09.276235 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:09.276285 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:09.276438 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.276983 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.278106 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.278303 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.278375 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.278543 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:09.278570 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:09.278604 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:09.278650 (+ 46us) server_negotiation.cc:299] Negotiation successful
0806 00:53:09.278667 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 00:53:09.284015 6634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.281550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:56817 (local address 127.3.98.130:32769)
0806 00:53:09.281586 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:09.281588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:09.281596 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:53:09.281655 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:09.281655 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:09.281664 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:09.281712 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:09.281898 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.282331 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.283344 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.283545 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.283602 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.283770 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:09.283794 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:09.283832 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:09.283918 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 00:53:09.283937 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":15}
I20260806 00:53:09.284222 6692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:09.281470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:32769 (local address 127.3.98.130:56817)
0806 00:53:09.281527 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:09.281540 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:09.281590 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:09.281794 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:09.281794 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:09.281796 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 00:53:09.281839 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:09.281840 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.282418 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.282419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:09.283256 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:09.283260 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:09.283633 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:09.283634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:09.283689 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:09.283696 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 00:53:09.283860 (+ 164us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 00:53:09.283862 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:53:09.283916 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 00:53:09.283972 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 00:53:09.286700 6153 raft_consensus.cc:1261] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Refusing update from remote peer 4b10a7a311824656b161f50c4edbb762: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:09.286720 6544 raft_consensus.cc:1261] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Refusing update from remote peer 4b10a7a311824656b161f50c4edbb762: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:09.286935 6694 consensus_queue.cc:1035] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:09.287057 6663 consensus_queue.cc:1035] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 00:53:09.292191 6671 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 00:53:10.811754 5935 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:10.811910 5935 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:10.812885 5935 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1: Sending DeleteTablet for 3 replicas of tablet 515980ff76084d0cbacb9a69ff605649
I20260806 00:53:10.813205 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 515980ff76084d0cbacb9a69ff605649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:10 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:57888
I20260806 00:53:10.813206 6517 tablet_service.cc:1514] Processing DeleteTablet for tablet 515980ff76084d0cbacb9a69ff605649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:10 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:57122
I20260806 00:53:10.813282 6322 tablet_service.cc:1514] Processing DeleteTablet for tablet 515980ff76084d0cbacb9a69ff605649 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:10 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:50324
I20260806 00:53:10.813572 6736 tablet_replica.cc:330] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539: stopping tablet replica
I20260806 00:53:10.813630 6736 raft_consensus.cc:2229] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:10.813684 6736 raft_consensus.cc:2258] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:10.813799 6737 tablet_replica.cc:330] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a: stopping tablet replica
I20260806 00:53:10.813848 6737 raft_consensus.cc:2229] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:10.813881 6737 raft_consensus.cc:2258] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:10.814193 6737 ts_tablet_manager.cc:1905] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:10.815850 6737 ts_tablet_manager.cc:1918] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 00:53:10.815917 6737 log.cc:1196] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/wal/wals/515980ff76084d0cbacb9a69ff605649
I20260806 00:53:10.816161 6737 ts_tablet_manager.cc:1939] T 515980ff76084d0cbacb9a69ff605649 P e310710f98264bccabcf04229e8d119a: Deleting consensus metadata
I20260806 00:53:10.816468 6736 ts_tablet_manager.cc:1905] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:10.816813 5907 catalog_manager.cc:4841] TS e310710f98264bccabcf04229e8d119a (127.3.98.129:43119): tablet 515980ff76084d0cbacb9a69ff605649 (table test-table [id=3af4bf8c2a4f455da9bdf854e941ee4b]) successfully deleted
I20260806 00:53:10.817942 6736 ts_tablet_manager.cc:1918] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 00:53:10.817997 6736 log.cc:1196] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/515980ff76084d0cbacb9a69ff605649
I20260806 00:53:10.818238 6736 ts_tablet_manager.cc:1939] T 515980ff76084d0cbacb9a69ff605649 P bc4fbc2ead02493c9a7c06eb75d62539: Deleting consensus metadata
I20260806 00:53:10.818645 5906 catalog_manager.cc:4841] TS bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131:44919): tablet 515980ff76084d0cbacb9a69ff605649 (table test-table [id=3af4bf8c2a4f455da9bdf854e941ee4b]) successfully deleted
I20260806 00:53:10.820621 6738 tablet_replica.cc:330] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762: stopping tablet replica
I20260806 00:53:10.820720 6738 raft_consensus.cc:2229] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:53:10.820850 6738 raft_consensus.cc:2258] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:10.821266 6738 ts_tablet_manager.cc:1905] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:10.823184 6738 ts_tablet_manager.cc:1918] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 00:53:10.823240 6738 log.cc:1196] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/515980ff76084d0cbacb9a69ff605649
I20260806 00:53:10.823494 6738 ts_tablet_manager.cc:1939] T 515980ff76084d0cbacb9a69ff605649 P 4b10a7a311824656b161f50c4edbb762: Deleting consensus metadata
I20260806 00:53:10.823843 5907 catalog_manager.cc:4841] TS 4b10a7a311824656b161f50c4edbb762 (127.3.98.130:32769): tablet 515980ff76084d0cbacb9a69ff605649 (table test-table [id=3af4bf8c2a4f455da9bdf854e941ee4b]) successfully deleted
Aug 06 00:53:10 dist-test-slave-44d2 krb5kdc[5863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977590, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 00:53:10 dist-test-slave-44d2 krb5kdc[5863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977590, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:10.841724 6748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:10.833500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36144 (local address 127.3.98.190:46509)
0806 00:53:10.833700 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:10.833702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:10.833732 (+ 30us) server_negotiation.cc:407] Connection header received
0806 00:53:10.833759 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:10.833760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:10.833770 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:10.833829 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:10.834497 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:10.835005 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:10.835779 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:10.835985 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:10.836039 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:10.838645 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:10.838648 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:10.838648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:10.838657 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:10.840082 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:10.840441 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:10.840442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:10.840442 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:10.840644 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:10.841078 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:10.841080 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:10.841080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:10.841300 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:10.841397 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:10.841558 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 00:53:10.841644 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":130,"threads_started":1}
I20260806 00:53:10.843679 5935 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36144:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:10.843887 5935 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:10.845615 6517 tablet_service.cc:1467] Processing CreateTablet for tablet f5d80582b7b54db79613839274ea42d4 (DEFAULT_TABLE table=test-table [id=f2a344ea6f494ceaa421ab84816b3935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:10.845607 6123 tablet_service.cc:1467] Processing CreateTablet for tablet f5d80582b7b54db79613839274ea42d4 (DEFAULT_TABLE table=test-table [id=f2a344ea6f494ceaa421ab84816b3935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:10.845788 6517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5d80582b7b54db79613839274ea42d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:10.845791 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5d80582b7b54db79613839274ea42d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:10.846938 6322 tablet_service.cc:1467] Processing CreateTablet for tablet f5d80582b7b54db79613839274ea42d4 (DEFAULT_TABLE table=test-table [id=f2a344ea6f494ceaa421ab84816b3935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:10.846976 6750 tablet_bootstrap.cc:492] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539: Bootstrap starting.
I20260806 00:53:10.847082 6322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5d80582b7b54db79613839274ea42d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:10.847368 6750 tablet_bootstrap.cc:654] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:10.848002 6750 tablet_bootstrap.cc:492] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539: No bootstrap required, opened a new log
I20260806 00:53:10.848038 6750 ts_tablet_manager.cc:1397] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:10.848153 6750 raft_consensus.cc:348] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:10.848202 6750 raft_consensus.cc:374] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:10.848215 6750 raft_consensus.cc:729] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc4fbc2ead02493c9a7c06eb75d62539, State: Initialized, Role: FOLLOWER
I20260806 00:53:10.848300 6750 consensus_queue.cc:260] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:10.848486 6750 ts_tablet_manager.cc:1428] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:10.848697 6758 tablet_bootstrap.cc:492] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762: Bootstrap starting.
I20260806 00:53:10.849000 6751 tablet_bootstrap.cc:492] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a: Bootstrap starting.
I20260806 00:53:10.849186 6758 tablet_bootstrap.cc:654] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:10.849462 6751 tablet_bootstrap.cc:654] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:10.850036 6758 tablet_bootstrap.cc:492] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762: No bootstrap required, opened a new log
I20260806 00:53:10.850090 6758 ts_tablet_manager.cc:1397] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:10.850206 6751 tablet_bootstrap.cc:492] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a: No bootstrap required, opened a new log
I20260806 00:53:10.850265 6751 ts_tablet_manager.cc:1397] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:10.850212 6758 raft_consensus.cc:348] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:10.850296 6758 raft_consensus.cc:374] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:10.850325 6758 raft_consensus.cc:729] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b10a7a311824656b161f50c4edbb762, State: Initialized, Role: FOLLOWER
I20260806 00:53:10.850381 6758 consensus_queue.cc:260] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:10.850507 6758 ts_tablet_manager.cc:1428] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:10.850472 6751 raft_consensus.cc:348] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:10.850564 6751 raft_consensus.cc:374] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:10.850598 6751 raft_consensus.cc:729] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e310710f98264bccabcf04229e8d119a, State: Initialized, Role: FOLLOWER
I20260806 00:53:10.850658 6751 consensus_queue.cc:260] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:10.850847 6751 ts_tablet_manager.cc:1428] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:11.281080 6761 raft_consensus.cc:482] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:11.281198 6761 raft_consensus.cc:504] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:11.281653 6761 leader_election.cc:288] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b10a7a311824656b161f50c4edbb762 (127.3.98.130:32769), bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131:44919)
I20260806 00:53:11.285501 6770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:11.282074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:37509 (local address 127.3.98.130:32769)
0806 00:53:11.282226 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:11.282228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:11.282264 (+ 36us) server_negotiation.cc:407] Connection header received
0806 00:53:11.282342 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:11.282343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:11.282356 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:11.282423 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:11.282654 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.283196 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.284639 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.285146 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.285222 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:11.285232 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:11.285373 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 00:53:11.285415 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
I20260806 00:53:11.285531 6768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:11.281986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:32769 (local address 127.3.98.129:37509)
0806 00:53:11.282183 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:11.282197 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:11.282265 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:11.282455 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:11.282456 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:11.282461 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:11.282570 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:11.282573 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.283308 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.283309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:11.284541 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:11.284544 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.285235 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.285236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:11.285293 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:11.285297 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:11.285384 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 00:53:11.285420 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":24,"thread_start_us":118,"threads_started":1}
I20260806 00:53:11.285887 6769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:11.282029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:52121 (local address 127.3.98.131:44919)
0806 00:53:11.282191 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:11.282193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:11.282278 (+ 85us) server_negotiation.cc:407] Connection header received
0806 00:53:11.282320 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:11.282321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:11.282334 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:11.282418 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:11.283143 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.283661 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.284870 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.285463 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.285539 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:11.285548 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:11.285762 (+ 214us) server_negotiation.cc:299] Negotiation successful
0806 00:53:11.285814 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":86,"threads_started":1}
I20260806 00:53:11.285837 6765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:11.281906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:44919 (local address 127.3.98.129:52121)
0806 00:53:11.282184 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:11.282197 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:11.282264 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:11.282455 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:11.282456 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:11.282460 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:11.283047 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:11.283051 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.283767 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.283768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:11.284795 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:11.284797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.285582 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.285583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:11.285667 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:11.285670 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:11.285723 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 00:53:11.285763 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":166,"threads_started":1}
I20260806 00:53:11.285883 6348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5d80582b7b54db79613839274ea42d4" candidate_uuid: "e310710f98264bccabcf04229e8d119a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b10a7a311824656b161f50c4edbb762" is_pre_election: true
I20260806 00:53:11.285997 6348 raft_consensus.cc:2454] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e310710f98264bccabcf04229e8d119a in term 0.
I20260806 00:53:11.286211 6053 leader_election.cc:302] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b10a7a311824656b161f50c4edbb762, e310710f98264bccabcf04229e8d119a; no voters:
I20260806 00:53:11.286295 6544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5d80582b7b54db79613839274ea42d4" candidate_uuid: "e310710f98264bccabcf04229e8d119a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" is_pre_election: true
I20260806 00:53:11.286379 6544 raft_consensus.cc:2454] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e310710f98264bccabcf04229e8d119a in term 0.
I20260806 00:53:11.286405 6761 raft_consensus.cc:2781] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:11.286484 6761 raft_consensus.cc:482] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:11.286511 6761 raft_consensus.cc:3037] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:11.287467 6761 raft_consensus.cc:504] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:11.287638 6761 leader_election.cc:288] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [CANDIDATE]: Term 1 election: Requested vote from peers 4b10a7a311824656b161f50c4edbb762 (127.3.98.130:32769), bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131:44919)
I20260806 00:53:11.287784 6544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5d80582b7b54db79613839274ea42d4" candidate_uuid: "e310710f98264bccabcf04229e8d119a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc4fbc2ead02493c9a7c06eb75d62539"
I20260806 00:53:11.287887 6544 raft_consensus.cc:3037] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:11.287801 6348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5d80582b7b54db79613839274ea42d4" candidate_uuid: "e310710f98264bccabcf04229e8d119a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b10a7a311824656b161f50c4edbb762"
I20260806 00:53:11.288034 6348 raft_consensus.cc:3037] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:11.288841 6544 raft_consensus.cc:2454] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e310710f98264bccabcf04229e8d119a in term 1.
I20260806 00:53:11.288956 6348 raft_consensus.cc:2454] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e310710f98264bccabcf04229e8d119a in term 1.
I20260806 00:53:11.289131 6053 leader_election.cc:302] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b10a7a311824656b161f50c4edbb762, e310710f98264bccabcf04229e8d119a; no voters:
I20260806 00:53:11.289335 6761 raft_consensus.cc:2781] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:11.289534 6761 raft_consensus.cc:686] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [term 1 LEADER]: Becoming Leader. State: Replica: e310710f98264bccabcf04229e8d119a, State: Running, Role: LEADER
I20260806 00:53:11.289640 6761 consensus_queue.cc:237] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:11.290477 5931 catalog_manager.cc:5495] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a reported cstate change: term changed from 0 to 1, leader changed from <none> to e310710f98264bccabcf04229e8d119a (127.3.98.129). New cstate: current_term: 1 leader_uuid: "e310710f98264bccabcf04229e8d119a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } health_report { overall_health: UNKNOWN } } }
I20260806 00:53:11.404911 6784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:11.401658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46856 (local address 127.3.98.129:43119)
0806 00:53:11.401813 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:11.401816 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:11.401876 (+ 60us) server_negotiation.cc:407] Connection header received
0806 00:53:11.401962 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:11.401962 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:11.401993 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:11.402104 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:11.402203 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.403132 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.403936 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.404193 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.404305 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:11.404547 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:11.404669 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:11.404735 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:11.404805 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 00:53:11.404834 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":67,"threads_started":1}
I20260806 00:53:11.410265 6770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:11.407873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:43169 (local address 127.3.98.130:32769)
0806 00:53:11.407934 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:11.407936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:11.407946 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:11.407974 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:11.407975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:11.407990 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:11.408064 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:11.408190 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.408752 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.409504 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.409708 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.409786 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:11.409981 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:11.410018 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:11.410095 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:11.410161 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 00:53:11.410186 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 00:53:11.410306 6788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:11.407673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:32769 (local address 127.3.98.129:43169)
0806 00:53:11.407851 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:11.407864 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:11.407924 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:11.408067 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:11.408068 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:11.408070 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 00:53:11.408134 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:11.408136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.408841 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.408842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:11.409416 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:11.409418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.409788 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.409789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:11.409865 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:11.409881 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 00:53:11.410101 (+ 220us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 00:53:11.410103 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:53:11.410156 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 00:53:11.410206 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":73,"threads_started":1}
I20260806 00:53:11.413426 6544 raft_consensus.cc:1261] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Refusing update from remote peer e310710f98264bccabcf04229e8d119a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:11.413467 6348 raft_consensus.cc:1261] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Refusing update from remote peer e310710f98264bccabcf04229e8d119a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:11.413708 6761 consensus_queue.cc:1035] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:11.413880 6771 consensus_queue.cc:1035] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:11.422914 6784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:11.419937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:47393 (local address 127.3.98.129:43119)
0806 00:53:11.419994 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:11.419996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:11.420205 (+ 209us) server_negotiation.cc:407] Connection header received
0806 00:53:11.420235 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:11.420236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:11.420249 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:11.420346 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:11.420473 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.421018 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.421993 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.422285 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.422390 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:11.422595 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:11.422648 (+ 53us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:11.422734 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:11.422811 (+ 77us) server_negotiation.cc:299] Negotiation successful
0806 00:53:11.422836 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 00:53:11.422964 6793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:11.419890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:43119 (local address 127.3.98.130:47393)
0806 00:53:11.420042 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:11.420054 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:11.420147 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:11.420349 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:11.420350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:11.420352 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 00:53:11.420408 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:11.420410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.421133 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.421134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:11.421883 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:11.421886 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:11.422418 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:11.422419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:11.422492 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:11.422497 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 00:53:11.422734 (+ 237us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 00:53:11.422737 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:11.422805 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 00:53:11.422867 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":99,"threads_started":1}
I20260806 00:53:11.433127 5935 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:11.433241 5935 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:11.434162 5935 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1: Sending DeleteTablet for 3 replicas of tablet f5d80582b7b54db79613839274ea42d4
I20260806 00:53:11.434437 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet f5d80582b7b54db79613839274ea42d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:11 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:57888
I20260806 00:53:11.434495 6322 tablet_service.cc:1514] Processing DeleteTablet for tablet f5d80582b7b54db79613839274ea42d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:11 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:50324
I20260806 00:53:11.434619 6517 tablet_service.cc:1514] Processing DeleteTablet for tablet f5d80582b7b54db79613839274ea42d4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:11 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:57122
I20260806 00:53:11.434839 6801 tablet_replica.cc:330] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539: stopping tablet replica
I20260806 00:53:11.434769 5935 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36144:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:11.434938 5935 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:11.435047 6801 raft_consensus.cc:2229] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:11.435081 6799 tablet_replica.cc:330] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a: stopping tablet replica
I20260806 00:53:11.435128 6801 raft_consensus.cc:2258] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:11.435237 6799 raft_consensus.cc:2229] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:53:11.435374 6799 raft_consensus.cc:2258] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:11.435494 6801 ts_tablet_manager.cc:1905] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:11.435707 6799 ts_tablet_manager.cc:1905] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:11.436245 6517 tablet_service.cc:1467] Processing CreateTablet for tablet 5014eeeb479746818ae8e6daac9a5bf3 (DEFAULT_TABLE table=test-table [id=77cb58f77cef4309b72346f171630b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:11.436372 6517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5014eeeb479746818ae8e6daac9a5bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:11.437563 6801 ts_tablet_manager.cc:1918] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:11.437620 6801 log.cc:1196] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/f5d80582b7b54db79613839274ea42d4
I20260806 00:53:11.437644 6799 ts_tablet_manager.cc:1918] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:11.437700 6799 log.cc:1196] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-0/wal/wals/f5d80582b7b54db79613839274ea42d4
I20260806 00:53:11.437903 6801 ts_tablet_manager.cc:1939] T f5d80582b7b54db79613839274ea42d4 P bc4fbc2ead02493c9a7c06eb75d62539: Deleting consensus metadata
I20260806 00:53:11.437961 6799 ts_tablet_manager.cc:1939] T f5d80582b7b54db79613839274ea42d4 P e310710f98264bccabcf04229e8d119a: Deleting consensus metadata
I20260806 00:53:11.438107 6123 tablet_service.cc:1467] Processing CreateTablet for tablet 5014eeeb479746818ae8e6daac9a5bf3 (DEFAULT_TABLE table=test-table [id=77cb58f77cef4309b72346f171630b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:11.438143 6800 tablet_replica.cc:330] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762: stopping tablet replica
I20260806 00:53:11.438217 6800 raft_consensus.cc:2229] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:11.438221 6123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5014eeeb479746818ae8e6daac9a5bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:11.438270 6800 raft_consensus.cc:2258] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:11.438638 6800 ts_tablet_manager.cc:1905] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:11.439323 6804 tablet_bootstrap.cc:492] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a: Bootstrap starting.
I20260806 00:53:11.439448 6322 tablet_service.cc:1467] Processing CreateTablet for tablet 5014eeeb479746818ae8e6daac9a5bf3 (DEFAULT_TABLE table=test-table [id=77cb58f77cef4309b72346f171630b53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:11.439546 5906 catalog_manager.cc:4841] TS bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131:44919): tablet f5d80582b7b54db79613839274ea42d4 (table test-table [id=f2a344ea6f494ceaa421ab84816b3935]) successfully deleted
I20260806 00:53:11.439577 6322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5014eeeb479746818ae8e6daac9a5bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:11.439733 5907 catalog_manager.cc:4841] TS e310710f98264bccabcf04229e8d119a (127.3.98.129:43119): tablet f5d80582b7b54db79613839274ea42d4 (table test-table [id=f2a344ea6f494ceaa421ab84816b3935]) successfully deleted
I20260806 00:53:11.440574 6800 ts_tablet_manager.cc:1918] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:11.440682 6800 log.cc:1196] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/f5d80582b7b54db79613839274ea42d4
I20260806 00:53:11.440944 6800 ts_tablet_manager.cc:1939] T f5d80582b7b54db79613839274ea42d4 P 4b10a7a311824656b161f50c4edbb762: Deleting consensus metadata
I20260806 00:53:11.441316 5907 catalog_manager.cc:4841] TS 4b10a7a311824656b161f50c4edbb762 (127.3.98.130:32769): tablet f5d80582b7b54db79613839274ea42d4 (table test-table [id=f2a344ea6f494ceaa421ab84816b3935]) successfully deleted
I20260806 00:53:11.441511 6805 tablet_bootstrap.cc:492] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762: Bootstrap starting.
I20260806 00:53:11.441700 6804 tablet_bootstrap.cc:654] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:11.441857 6803 tablet_bootstrap.cc:492] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539: Bootstrap starting.
I20260806 00:53:11.442183 6805 tablet_bootstrap.cc:654] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:11.442270 6803 tablet_bootstrap.cc:654] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:11.442543 6804 tablet_bootstrap.cc:492] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a: No bootstrap required, opened a new log
I20260806 00:53:11.442647 6804 ts_tablet_manager.cc:1397] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 00:53:11.442919 6804 raft_consensus.cc:348] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:11.443042 6804 raft_consensus.cc:374] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:11.443068 6804 raft_consensus.cc:729] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e310710f98264bccabcf04229e8d119a, State: Initialized, Role: FOLLOWER
I20260806 00:53:11.443107 6805 tablet_bootstrap.cc:492] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762: No bootstrap required, opened a new log
I20260806 00:53:11.443154 6805 ts_tablet_manager.cc:1397] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:53:11.443142 6804 consensus_queue.cc:260] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:11.443281 6805 raft_consensus.cc:348] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:11.443389 6805 raft_consensus.cc:374] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:11.443394 6804 ts_tablet_manager.cc:1428] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260806 00:53:11.443418 6805 raft_consensus.cc:729] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b10a7a311824656b161f50c4edbb762, State: Initialized, Role: FOLLOWER
I20260806 00:53:11.443467 6805 consensus_queue.cc:260] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:11.443570 6805 ts_tablet_manager.cc:1428] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:11.444710 6803 tablet_bootstrap.cc:492] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539: No bootstrap required, opened a new log
I20260806 00:53:11.444785 6803 ts_tablet_manager.cc:1397] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 00:53:11.444926 6803 raft_consensus.cc:348] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:11.445019 6803 raft_consensus.cc:374] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:11.445042 6803 raft_consensus.cc:729] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc4fbc2ead02493c9a7c06eb75d62539, State: Initialized, Role: FOLLOWER
I20260806 00:53:11.445097 6803 consensus_queue.cc:260] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:11.445194 6803 ts_tablet_manager.cc:1428] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:11.457406 6795 raft_consensus.cc:482] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:11.457506 6795 raft_consensus.cc:504] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:11.457700 6795 leader_election.cc:288] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b10a7a311824656b161f50c4edbb762 (127.3.98.130:32769), bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131:44919)
I20260806 00:53:11.457850 6348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5014eeeb479746818ae8e6daac9a5bf3" candidate_uuid: "e310710f98264bccabcf04229e8d119a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b10a7a311824656b161f50c4edbb762" is_pre_election: true
I20260806 00:53:11.457875 6544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5014eeeb479746818ae8e6daac9a5bf3" candidate_uuid: "e310710f98264bccabcf04229e8d119a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" is_pre_election: true
I20260806 00:53:11.457952 6348 raft_consensus.cc:2454] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e310710f98264bccabcf04229e8d119a in term 0.
I20260806 00:53:11.457955 6544 raft_consensus.cc:2454] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e310710f98264bccabcf04229e8d119a in term 0.
I20260806 00:53:11.458140 6053 leader_election.cc:302] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b10a7a311824656b161f50c4edbb762, e310710f98264bccabcf04229e8d119a; no voters:
I20260806 00:53:11.458245 6795 raft_consensus.cc:2781] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:11.458297 6795 raft_consensus.cc:482] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:11.458328 6795 raft_consensus.cc:3037] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:11.459045 6795 raft_consensus.cc:504] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:11.459194 6795 leader_election.cc:288] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [CANDIDATE]: Term 1 election: Requested vote from peers 4b10a7a311824656b161f50c4edbb762 (127.3.98.130:32769), bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131:44919)
I20260806 00:53:11.459349 6348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5014eeeb479746818ae8e6daac9a5bf3" candidate_uuid: "e310710f98264bccabcf04229e8d119a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b10a7a311824656b161f50c4edbb762"
I20260806 00:53:11.459368 6544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5014eeeb479746818ae8e6daac9a5bf3" candidate_uuid: "e310710f98264bccabcf04229e8d119a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc4fbc2ead02493c9a7c06eb75d62539"
I20260806 00:53:11.459429 6348 raft_consensus.cc:3037] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:11.459429 6544 raft_consensus.cc:3037] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:11.460215 6544 raft_consensus.cc:2454] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e310710f98264bccabcf04229e8d119a in term 1.
I20260806 00:53:11.460215 6348 raft_consensus.cc:2454] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e310710f98264bccabcf04229e8d119a in term 1.
I20260806 00:53:11.460395 6053 leader_election.cc:302] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b10a7a311824656b161f50c4edbb762, e310710f98264bccabcf04229e8d119a; no voters:
I20260806 00:53:11.460511 6795 raft_consensus.cc:2781] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:11.460556 6795 raft_consensus.cc:686] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [term 1 LEADER]: Becoming Leader. State: Replica: e310710f98264bccabcf04229e8d119a, State: Running, Role: LEADER
I20260806 00:53:11.460594 6795 consensus_queue.cc:237] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } }
I20260806 00:53:11.461199 5935 catalog_manager.cc:5495] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a reported cstate change: term changed from 0 to 1, leader changed from <none> to e310710f98264bccabcf04229e8d119a (127.3.98.129). New cstate: current_term: 1 leader_uuid: "e310710f98264bccabcf04229e8d119a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e310710f98264bccabcf04229e8d119a" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 } health_report { overall_health: UNKNOWN } } }
I20260806 00:53:11.468852 6544 raft_consensus.cc:1261] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Refusing update from remote peer e310710f98264bccabcf04229e8d119a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:11.468883 6348 raft_consensus.cc:1261] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Refusing update from remote peer e310710f98264bccabcf04229e8d119a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:11.469070 6761 consensus_queue.cc:1035] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b10a7a311824656b161f50c4edbb762" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 32769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:11.469164 6795 consensus_queue.cc:1035] T 5014eeeb479746818ae8e6daac9a5bf3 P e310710f98264bccabcf04229e8d119a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc4fbc2ead02493c9a7c06eb75d62539" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 44919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 00:53:11.474356 6776 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 00:53:12.992997 5935 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:12.993119 5935 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:12.993953 5935 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 807d08871fa049cfb5eb036457a000b1: Sending DeleteTablet for 3 replicas of tablet 5014eeeb479746818ae8e6daac9a5bf3
I20260806 00:53:12.994220 6322 tablet_service.cc:1514] Processing DeleteTablet for tablet 5014eeeb479746818ae8e6daac9a5bf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:12 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:50324
I20260806 00:53:12.994228 6517 tablet_service.cc:1514] Processing DeleteTablet for tablet 5014eeeb479746818ae8e6daac9a5bf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:12 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:57122
I20260806 00:53:12.994261 6123 tablet_service.cc:1514] Processing DeleteTablet for tablet 5014eeeb479746818ae8e6daac9a5bf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:12 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:57888
I20260806 00:53:12.994446 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 6030
I20260806 00:53:13.003556 6839 tablet_replica.cc:330] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762: stopping tablet replica
I20260806 00:53:13.003662 6839 raft_consensus.cc:2229] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:13.003705 6839 raft_consensus.cc:2258] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:13.003852 6838 tablet_replica.cc:330] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539: stopping tablet replica
I20260806 00:53:13.003990 6838 raft_consensus.cc:2229] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:13.004060 6838 raft_consensus.cc:2258] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:13.004081 6839 ts_tablet_manager.cc:1905] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:13.004366 6838 ts_tablet_manager.cc:1905] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:13.005870 6839 ts_tablet_manager.cc:1918] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 00:53:13.005952 6839 log.cc:1196] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/5014eeeb479746818ae8e6daac9a5bf3
I20260806 00:53:13.006193 6839 ts_tablet_manager.cc:1939] T 5014eeeb479746818ae8e6daac9a5bf3 P 4b10a7a311824656b161f50c4edbb762: Deleting consensus metadata
I20260806 00:53:13.006633 6838 ts_tablet_manager.cc:1918] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 00:53:13.006705 6838 log.cc:1196] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/5014eeeb479746818ae8e6daac9a5bf3
I20260806 00:53:13.006803 5907 catalog_manager.cc:4841] TS 4b10a7a311824656b161f50c4edbb762 (127.3.98.130:32769): tablet 5014eeeb479746818ae8e6daac9a5bf3 (table test-table [id=77cb58f77cef4309b72346f171630b53]) successfully deleted
I20260806 00:53:13.007016 6838 ts_tablet_manager.cc:1939] T 5014eeeb479746818ae8e6daac9a5bf3 P bc4fbc2ead02493c9a7c06eb75d62539: Deleting consensus metadata
I20260806 00:53:13.007401 5906 catalog_manager.cc:4841] TS bc4fbc2ead02493c9a7c06eb75d62539 (127.3.98.131:44919): tablet 5014eeeb479746818ae8e6daac9a5bf3 (table test-table [id=77cb58f77cef4309b72346f171630b53]) successfully deleted
W20260806 00:53:13.011165 5907 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:43119 (error 108)
I20260806 00:53:13.011435 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 6228
I20260806 00:53:13.017163 6842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:13.015830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:43119 (local address 127.0.0.1:46872)
0806 00:53:13.017039 (+ 1209us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:13.017105 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:43119: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1181,"thread_start_us":542,"threads_started":1}
W20260806 00:53:13.017304 5907 catalog_manager.cc:4584] TS e310710f98264bccabcf04229e8d119a (127.3.98.129:43119): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5014eeeb479746818ae8e6daac9a5bf3: Network error: Client connection negotiation failed: client connection to 127.3.98.129:43119: connect: Connection refused (error 111)
I20260806 00:53:13.027164 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 6435
I20260806 00:53:13.041889 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 5881
2026-08-06T00:53:13Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6330 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:13 dist-test-slave-44d2 krb5kdc[6846](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:13 dist-test-slave-44d2 krb5kdc[6846](info): set up 2 sockets
Aug 06 00:53:13 dist-test-slave-44d2 krb5kdc[6846](info): commencing operation
krb5kdc: starting...
W20260806 00:53:14.270368 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:14 dist-test-slave-44d2 krb5kdc[6846](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:53:14.402107 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:34969
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:38901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:34969
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:14.488673 6865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:14.488914 6865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:14.488951 6865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:14.490136 6865 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:14.490209 6865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:14.490232 6865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:14.490254 6865 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:14.490283 6865 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:14.491851 6865 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:38901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:34969
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:34969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:14.492154 6865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:14.492403 6865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:14.497659 6873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:14.497684 6877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:14.497670 6874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:14.498082 6865 server_base.cc:1034] running on GCE node
I20260806 00:53:14.498353 6865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:14.498665 6865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:14.499831 6865 hybrid_clock.cc:648] HybridClock initialized: now 1785977594499814 us; error 40 us; skew 500 ppm
Aug 06 00:53:14 dist-test-slave-44d2 krb5kdc[6846](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977594, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:14.502488 6865 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:53:14.502930 6865 webserver.cc:460] Webserver started at http://127.3.98.190:32971/ using document root <none> and password file <none>
I20260806 00:53:14.503196 6865 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:14.503268 6865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:14.503420 6865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:14.504585 6865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "b5bb8336447443799291123b1b838252"
format_stamp: "Formatted at 2026-08-06 00:53:14 on dist-test-slave-44d2"
server_key: "c91abaeb0a3861d349f26ffac4616e69"
server_key_iv: "82a20d05798b7fba6b5ce5af8009c74d"
server_key_version: "encryptionkey@0"
I20260806 00:53:14.504952 6865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "b5bb8336447443799291123b1b838252"
format_stamp: "Formatted at 2026-08-06 00:53:14 on dist-test-slave-44d2"
server_key: "c91abaeb0a3861d349f26ffac4616e69"
server_key_iv: "82a20d05798b7fba6b5ce5af8009c74d"
server_key_version: "encryptionkey@0"
I20260806 00:53:14.506263 6865 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 00:53:14.506994 6891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:14.507176 6865 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:14.507287 6865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "b5bb8336447443799291123b1b838252"
format_stamp: "Formatted at 2026-08-06 00:53:14 on dist-test-slave-44d2"
server_key: "c91abaeb0a3861d349f26ffac4616e69"
server_key_iv: "82a20d05798b7fba6b5ce5af8009c74d"
server_key_version: "encryptionkey@0"
I20260806 00:53:14.507364 6865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:14.514954 6865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:14.516781 6865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:14.516942 6865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:14.521243 6865 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:34969
I20260806 00:53:14.521298 6970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:34969 every 8 connection(s)
I20260806 00:53:14.521696 6865 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:14.522604 6971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:14.525079 6971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252: Bootstrap starting.
I20260806 00:53:14.525688 6971 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:14.526019 6971 log.cc:824] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:14.526724 6971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252: No bootstrap required, opened a new log
I20260806 00:53:14.528245 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 6865
I20260806 00:53:14.528328 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:14.528415 6971 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bb8336447443799291123b1b838252" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34969 } }
I20260806 00:53:14.528620 3466 external_mini_cluster.cc:1428] Setting key e33090c120124bf963d845d0ee4b4443
I20260806 00:53:14.528645 6971 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:14.528699 6971 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5bb8336447443799291123b1b838252, State: Initialized, Role: FOLLOWER
I20260806 00:53:14.528855 6971 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bb8336447443799291123b1b838252" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34969 } }
I20260806 00:53:14.528951 6971 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:14.528988 6971 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:14.529050 6971 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:14.530226 6971 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bb8336447443799291123b1b838252" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34969 } }
I20260806 00:53:14.530352 6971 leader_election.cc:302] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5bb8336447443799291123b1b838252; no voters:
I20260806 00:53:14.530531 6971 leader_election.cc:288] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:14.530597 6977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:14.530761 6977 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [term 1 LEADER]: Becoming Leader. State: Replica: b5bb8336447443799291123b1b838252, State: Running, Role: LEADER
I20260806 00:53:14.530812 6971 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:14.530859 6977 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bb8336447443799291123b1b838252" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34969 } }
I20260806 00:53:14.531203 6977 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5bb8336447443799291123b1b838252. Latest consensus state: current_term: 1 leader_uuid: "b5bb8336447443799291123b1b838252" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bb8336447443799291123b1b838252" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34969 } } }
I20260806 00:53:14.531278 6977 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:14.531435 6978 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5bb8336447443799291123b1b838252" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bb8336447443799291123b1b838252" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34969 } } }
I20260806 00:53:14.531500 6978 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:14.531836 6986 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:14.532366 6986 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:14.534348 6986 catalog_manager.cc:1347] Generated new cluster ID: f622cd675128401290eab69be4f2f3b3
I20260806 00:53:14.534406 6986 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:53:14 dist-test-slave-44d2 krb5kdc[6846](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977594, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:14.542392 6976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:14.529212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33524 (local address 127.3.98.190:34969)
0806 00:53:14.529436 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:14.529447 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:14.529485 (+ 38us) server_negotiation.cc:407] Connection header received
0806 00:53:14.529650 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:14.529659 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:14.529731 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:14.529925 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:14.530664 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:14.532168 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:14.533202 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:14.533622 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:14.533772 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:14.538406 (+ 4634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:14.538410 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:14.538410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:14.538430 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:14.540724 (+ 2294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:14.541131 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:14.541134 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:14.541135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:14.541226 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:14.541440 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:14.541441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:14.541441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:14.541692 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:14.541878 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:14.541980 (+ 102us) server_negotiation.cc:299] Negotiation successful
0806 00:53:14.542228 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":114,"threads_started":1}
I20260806 00:53:14.547005 6986 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:14.547688 6986 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:14.561729 6986 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5bb8336447443799291123b1b838252: Generated new TSK 0
I20260806 00:53:14.561995 6986 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:53:14.595568 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:34969
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:38901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:14.688441 7006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:14.688740 7006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:14.688782 7006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:14.689951 7006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:14.690016 7006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:14.690059 7006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:14.691483 7006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:38901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:34969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:14.691737 7006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:14.691975 7006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:14.697381 7013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:14.697499 7012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:14.697402 7017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:14.697772 7006 server_base.cc:1034] running on GCE node
I20260806 00:53:14.698026 7006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:14.698278 7006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:14.699440 7006 hybrid_clock.cc:648] HybridClock initialized: now 1785977594699432 us; error 40 us; skew 500 ppm
Aug 06 00:53:14 dist-test-slave-44d2 krb5kdc[6846](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977594, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:14.702147 7006 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:53:14.702593 7006 webserver.cc:460] Webserver started at http://127.3.98.129:46433/ using document root <none> and password file <none>
I20260806 00:53:14.702777 7006 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:14.702818 7006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:14.702910 7006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:14.704077 7006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "f27600d21f5243a892cf5c7b4527a1b6"
format_stamp: "Formatted at 2026-08-06 00:53:14 on dist-test-slave-44d2"
server_key: "d7426d1d9c6e43add334a88db625efd1"
server_key_iv: "ee2d74cfbb3148f583c915743e9b30f4"
server_key_version: "encryptionkey@0"
I20260806 00:53:14.704418 7006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "f27600d21f5243a892cf5c7b4527a1b6"
format_stamp: "Formatted at 2026-08-06 00:53:14 on dist-test-slave-44d2"
server_key: "d7426d1d9c6e43add334a88db625efd1"
server_key_iv: "ee2d74cfbb3148f583c915743e9b30f4"
server_key_version: "encryptionkey@0"
I20260806 00:53:14.705813 7006 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:14.706591 7028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:14.706804 7006 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:14.706928 7006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "f27600d21f5243a892cf5c7b4527a1b6"
format_stamp: "Formatted at 2026-08-06 00:53:14 on dist-test-slave-44d2"
server_key: "d7426d1d9c6e43add334a88db625efd1"
server_key_iv: "ee2d74cfbb3148f583c915743e9b30f4"
server_key_version: "encryptionkey@0"
I20260806 00:53:14.707003 7006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:14.718101 7006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:14.720724 7006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:14.720970 7006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:14.721288 7006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:14.721765 7006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:14.721824 7006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:14.721908 7006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:14.721956 7006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:14.728613 7006 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:37365
I20260806 00:53:14.728709 7187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:37365 every 8 connection(s)
I20260806 00:53:14.729084 7006 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:53:14.732085 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 7006
I20260806 00:53:14.732213 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:14.732384 3466 external_mini_cluster.cc:1428] Setting key fd684737b6446987f91e82a79c0fc5fb
Aug 06 00:53:14 dist-test-slave-44d2 krb5kdc[6846](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977594, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:14.740988 6976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:14.729891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:43615 (local address 127.3.98.190:34969)
0806 00:53:14.729971 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:14.729974 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:14.730182 (+ 208us) server_negotiation.cc:407] Connection header received
0806 00:53:14.730718 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:14.730720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:14.730737 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:14.730821 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:14.732613 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:14.733280 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:14.734788 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:14.735141 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:14.735218 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:14.737667 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:14.737669 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:14.737670 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:14.737682 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:14.739477 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:14.739890 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:14.739891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:14.739892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:14.739959 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:14.740203 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:14.740204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:14.740204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:14.740360 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:14.740439 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:14.740765 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 00:53:14.740866 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 00:53:14.741120 7192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:14.729839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:34969 (local address 127.3.98.129:43615)
0806 00:53:14.730017 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:14.730061 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:14.730564 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:14.730893 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:14.730897 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:14.731572 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:14.731831 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:14.731850 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:14.733376 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:14.733377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:14.734696 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:14.734700 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:14.735236 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:14.735237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:14.735346 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:14.735926 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:14.735935 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:14.737563 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:14.739579 (+ 2016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:14.739587 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:14.739589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:14.739811 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:14.740033 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:14.740034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:14.740034 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:14.740133 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:14.740432 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:14.740437 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:14.740618 (+ 181us) client_negotiation.cc:769] Sending connection context
0806 00:53:14.740707 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 00:53:14.740830 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":99,"threads_started":1}
I20260806 00:53:14.741717 7189 heartbeater.cc:347] Connected to a master server at 127.3.98.190:34969
I20260806 00:53:14.741838 7189 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:14.742059 7189 heartbeater.cc:511] Master 127.3.98.190:34969 requested a full tablet report, sending...
I20260806 00:53:14.742679 6923 ts_manager.cc:194] Registered new tserver with Master: f27600d21f5243a892cf5c7b4527a1b6 (127.3.98.129:37365)
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
I20260806 00:53:14.743458 6923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:43615
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:53:14.763408 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:34969
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:38901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:14.855221 7196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:14.855429 7196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:14.855453 7196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:14.856669 7196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:14.856714 7196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:14.856760 7196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:14.858178 7196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:38901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:34969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:14.858424 7196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:14.858664 7196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:14.863891 7207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:14.863935 7214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:14.863936 7210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:14.864136 7196 server_base.cc:1034] running on GCE node
I20260806 00:53:14.864398 7196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:14.864675 7196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:14.865826 7196 hybrid_clock.cc:648] HybridClock initialized: now 1785977594865815 us; error 29 us; skew 500 ppm
Aug 06 00:53:14 dist-test-slave-44d2 krb5kdc[6846](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977594, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:14.868458 7196 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:53:14.869136 7196 webserver.cc:460] Webserver started at http://127.3.98.130:33433/ using document root <none> and password file <none>
I20260806 00:53:14.869424 7196 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:14.869503 7196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:14.869668 7196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:14.870816 7196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "9dc8467a3bd048219b1611f2520516a0"
format_stamp: "Formatted at 2026-08-06 00:53:14 on dist-test-slave-44d2"
server_key: "baf53aaa6a88bdc938e33eff20f0bfa5"
server_key_iv: "7ab9352db436edb5d4618fb2a7aded48"
server_key_version: "encryptionkey@0"
I20260806 00:53:14.871227 7196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "9dc8467a3bd048219b1611f2520516a0"
format_stamp: "Formatted at 2026-08-06 00:53:14 on dist-test-slave-44d2"
server_key: "baf53aaa6a88bdc938e33eff20f0bfa5"
server_key_iv: "7ab9352db436edb5d4618fb2a7aded48"
server_key_version: "encryptionkey@0"
I20260806 00:53:14.872859 7196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260806 00:53:14.873719 7223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:14.873912 7196 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:14.874011 7196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "9dc8467a3bd048219b1611f2520516a0"
format_stamp: "Formatted at 2026-08-06 00:53:14 on dist-test-slave-44d2"
server_key: "baf53aaa6a88bdc938e33eff20f0bfa5"
server_key_iv: "7ab9352db436edb5d4618fb2a7aded48"
server_key_version: "encryptionkey@0"
I20260806 00:53:14.874099 7196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:14.888581 7196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:14.890821 7196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:14.891006 7196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:14.891275 7196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:14.891625 7196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:14.891685 7196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:14.891726 7196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:14.891769 7196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:14.898139 7196 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:38909
I20260806 00:53:14.898279 7385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:38909 every 8 connection(s)
I20260806 00:53:14.898579 7196 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:14.901856 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 7196
I20260806 00:53:14.901974 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:14.902172 3466 external_mini_cluster.cc:1428] Setting key 90df108040a297e312c914d50ada958f
Aug 06 00:53:14 dist-test-slave-44d2 krb5kdc[6846](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977594, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:14.909649 6976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:14.899335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:59659 (local address 127.3.98.190:34969)
0806 00:53:14.899379 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:14.899381 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:14.899659 (+ 278us) server_negotiation.cc:407] Connection header received
0806 00:53:14.900152 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:14.900153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:14.900162 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:14.900222 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:14.901268 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:14.901788 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:14.903237 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:14.903452 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:14.903516 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:14.905995 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:14.905996 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:14.905997 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:14.906006 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:14.907742 (+ 1736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:14.908356 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:14.908359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:14.908359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:14.908431 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:14.908773 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:14.908774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:14.908774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:14.908946 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:14.909039 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:14.909380 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 00:53:14.909487 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 00:53:14.909802 7389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:14.899292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:34969 (local address 127.3.98.130:59659)
0806 00:53:14.899517 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:14.899569 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:14.900065 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:14.900310 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:14.900313 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:14.900991 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:14.901187 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:14.901192 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:14.901886 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:14.901886 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:14.903148 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:14.903152 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:14.903550 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:14.903551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:14.903708 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:14.904244 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:14.904256 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:14.905885 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:14.907966 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:14.907974 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:14.907977 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:14.908266 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:14.908573 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:14.908574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:14.908574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:14.908691 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:14.909032 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:14.909037 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:14.909221 (+ 184us) client_negotiation.cc:769] Sending connection context
0806 00:53:14.909307 (+ 86us) client_negotiation.cc:240] Negotiation successful
0806 00:53:14.909498 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":96,"threads_started":1}
I20260806 00:53:14.910403 7387 heartbeater.cc:347] Connected to a master server at 127.3.98.190:34969
I20260806 00:53:14.910499 7387 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:14.910748 7387 heartbeater.cc:511] Master 127.3.98.190:34969 requested a full tablet report, sending...
I20260806 00:53:14.911197 6923 ts_manager.cc:194] Registered new tserver with Master: 9dc8467a3bd048219b1611f2520516a0 (127.3.98.130:38909)
I20260806 00:53:14.911734 6923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:59659
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:53:14.932858 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:34969
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:38901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:15.017848 7393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:15.018098 7393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:15.018123 7393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:15.019232 7393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:15.019264 7393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:15.019289 7393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:15.020738 7393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:38901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:34969
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:15.020933 7393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:15.021098 7393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:15.025956 7406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:15.025967 7401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:15.026005 7400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:15.026306 7393 server_base.cc:1034] running on GCE node
I20260806 00:53:15.026590 7393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:15.026821 7393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:15.027957 7393 hybrid_clock.cc:648] HybridClock initialized: now 1785977595027949 us; error 31 us; skew 500 ppm
Aug 06 00:53:15 dist-test-slave-44d2 krb5kdc[6846](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977595, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:15.030633 7393 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:53:15.031052 7393 webserver.cc:460] Webserver started at http://127.3.98.131:43947/ using document root <none> and password file <none>
I20260806 00:53:15.031299 7393 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:15.031373 7393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:15.031551 7393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:15.032894 7393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "05ff9b89e8404069901acc8a2ba96ecf"
format_stamp: "Formatted at 2026-08-06 00:53:15 on dist-test-slave-44d2"
server_key: "9461c09bb9cf19601ff291c27a3f428f"
server_key_iv: "113f65280f771e11761723bf2949a61f"
server_key_version: "encryptionkey@0"
I20260806 00:53:15.033262 7393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "05ff9b89e8404069901acc8a2ba96ecf"
format_stamp: "Formatted at 2026-08-06 00:53:15 on dist-test-slave-44d2"
server_key: "9461c09bb9cf19601ff291c27a3f428f"
server_key_iv: "113f65280f771e11761723bf2949a61f"
server_key_version: "encryptionkey@0"
I20260806 00:53:15.034716 7393 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:53:15.035511 7414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:15.035686 7393 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:15.035786 7393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "05ff9b89e8404069901acc8a2ba96ecf"
format_stamp: "Formatted at 2026-08-06 00:53:15 on dist-test-slave-44d2"
server_key: "9461c09bb9cf19601ff291c27a3f428f"
server_key_iv: "113f65280f771e11761723bf2949a61f"
server_key_version: "encryptionkey@0"
I20260806 00:53:15.035871 7393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:15.091503 7393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:15.093595 7393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:15.093763 7393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:15.094059 7393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:15.094372 7393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:15.094405 7393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:15.094429 7393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:15.094440 7393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:15.100225 7393 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:43079
I20260806 00:53:15.100328 7582 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:43079 every 8 connection(s)
I20260806 00:53:15.100678 7393 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
Aug 06 00:53:15 dist-test-slave-44d2 krb5kdc[6846](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977595, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:15.109390 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 7393
I20260806 00:53:15.109500 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:15.109714 3466 external_mini_cluster.cc:1428] Setting key be4beab193e5334a35d8bbe8501568a5
I20260806 00:53:15.110841 6976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:15.101448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:52563 (local address 127.3.98.190:34969)
0806 00:53:15.101517 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:15.101519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:15.101785 (+ 266us) server_negotiation.cc:407] Connection header received
0806 00:53:15.102267 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:15.102268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:15.102279 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:15.102347 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:15.103278 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:15.103777 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:15.104816 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:15.105009 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:15.105072 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:15.107089 (+ 2017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:15.107090 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:15.107090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:15.107097 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:15.109021 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:15.109581 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:15.109582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:15.109582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:15.109654 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:15.110029 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:15.110029 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:15.110030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:15.110182 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:15.110281 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:15.110651 (+ 370us) server_negotiation.cc:299] Negotiation successful
0806 00:53:15.110755 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 00:53:15.111107 7585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:15.101416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:34969 (local address 127.3.98.131:52563)
0806 00:53:15.101617 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:15.101659 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:15.102146 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:15.102402 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:15.102405 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:15.102967 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:15.103189 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:15.103194 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:15.103862 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:15.103863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:15.104735 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:15.104738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:15.105096 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:15.105097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:15.105199 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:15.105621 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:15.105629 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:15.106992 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:15.109130 (+ 2138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:15.109136 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:15.109137 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:15.109477 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:15.109737 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:15.109738 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:15.109738 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:15.109892 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:15.110286 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:15.110293 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:15.110449 (+ 156us) client_negotiation.cc:769] Sending connection context
0806 00:53:15.110593 (+ 144us) client_negotiation.cc:240] Negotiation successful
0806 00:53:15.110812 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":93,"threads_started":1}
I20260806 00:53:15.111569 7583 heartbeater.cc:347] Connected to a master server at 127.3.98.190:34969
I20260806 00:53:15.111649 7583 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:15.111780 7583 heartbeater.cc:511] Master 127.3.98.190:34969 requested a full tablet report, sending...
I20260806 00:53:15.112105 6923 ts_manager.cc:194] Registered new tserver with Master: 05ff9b89e8404069901acc8a2ba96ecf (127.3.98.131:43079)
I20260806 00:53:15.112514 6923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:52563
I20260806 00:53:15.121717 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 00:53:15.136299 6976 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:15.135151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33540 (local address 127.3.98.190:34969)
0806 00:53:15.135291 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:15.135294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:15.135420 (+ 126us) server_negotiation.cc:407] Connection header received
0806 00:53:15.135501 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:15.135502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:15.135521 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:15.135590 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:15.136212 (+ 622us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33540: BlockingRecv error: recv got EOF from 127.0.0.1:33540 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
I20260806 00:53:15.137226 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 7006
I20260806 00:53:15.153122 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 7196
I20260806 00:53:15.170266 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 7393
I20260806 00:53:15.180929 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 6865
2026-08-06T00:53:15Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2139 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:15 dist-test-slave-44d2 krb5kdc[7601](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:15 dist-test-slave-44d2 krb5kdc[7601](info): set up 2 sockets
Aug 06 00:53:15 dist-test-slave-44d2 krb5kdc[7601](info): commencing operation
krb5kdc: starting...
W20260806 00:53:16.415264 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:16 dist-test-slave-44d2 krb5kdc[7601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:53:16.543638 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:35135
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:35135
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:16.631196 7617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:16.631404 7617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:16.631428 7617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:16.632524 7617 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:16.632558 7617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:16.632572 7617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:16.632601 7617 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:16.632614 7617 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:16.634047 7617 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:35135
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:35135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7617
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:16.634232 7617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:16.634410 7617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:16.639652 7627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:16.639643 7630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:16.639643 7628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:16.639837 7617 server_base.cc:1034] running on GCE node
I20260806 00:53:16.640373 7617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:16.640743 7617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:16.641927 7617 hybrid_clock.cc:648] HybridClock initialized: now 1785977596641910 us; error 34 us; skew 500 ppm
Aug 06 00:53:16 dist-test-slave-44d2 krb5kdc[7601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977596, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:16.644955 7617 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:53:16.645557 7617 webserver.cc:460] Webserver started at http://127.3.98.190:40969/ using document root <none> and password file <none>
I20260806 00:53:16.645857 7617 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:16.645931 7617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:16.646082 7617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:16.647918 7617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "91ed915588bf45eb82b602d6f34e9af6"
format_stamp: "Formatted at 2026-08-06 00:53:16 on dist-test-slave-44d2"
server_key: "3d07899d3ef317b8fc099b18db94afc5"
server_key_iv: "440596174644988780c2c2b738b74735"
server_key_version: "encryptionkey@0"
I20260806 00:53:16.648465 7617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "91ed915588bf45eb82b602d6f34e9af6"
format_stamp: "Formatted at 2026-08-06 00:53:16 on dist-test-slave-44d2"
server_key: "3d07899d3ef317b8fc099b18db94afc5"
server_key_iv: "440596174644988780c2c2b738b74735"
server_key_version: "encryptionkey@0"
I20260806 00:53:16.650570 7617 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260806 00:53:16.652175 7639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:16.652416 7617 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:16.652537 7617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "91ed915588bf45eb82b602d6f34e9af6"
format_stamp: "Formatted at 2026-08-06 00:53:16 on dist-test-slave-44d2"
server_key: "3d07899d3ef317b8fc099b18db94afc5"
server_key_iv: "440596174644988780c2c2b738b74735"
server_key_version: "encryptionkey@0"
I20260806 00:53:16.652647 7617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:16.663614 7617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:16.665604 7617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:16.665766 7617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:16.670025 7617 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:35135
I20260806 00:53:16.670071 7705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:35135 every 8 connection(s)
I20260806 00:53:16.670432 7617 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:16.671334 7706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:16.673736 7706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6: Bootstrap starting.
I20260806 00:53:16.674373 7706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:16.674690 7706 log.cc:824] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:16.675446 7706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6: No bootstrap required, opened a new log
I20260806 00:53:16.677187 7706 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ed915588bf45eb82b602d6f34e9af6" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35135 } }
I20260806 00:53:16.677326 7706 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:16.677348 7706 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91ed915588bf45eb82b602d6f34e9af6, State: Initialized, Role: FOLLOWER
I20260806 00:53:16.677536 7706 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ed915588bf45eb82b602d6f34e9af6" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35135 } }
I20260806 00:53:16.677634 7706 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:16.677657 7706 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:16.677713 7706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:16.678606 7706 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ed915588bf45eb82b602d6f34e9af6" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35135 } }
I20260806 00:53:16.678728 7706 leader_election.cc:302] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91ed915588bf45eb82b602d6f34e9af6; no voters:
I20260806 00:53:16.678936 7706 leader_election.cc:288] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:16.679008 7715 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:16.679215 7715 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [term 1 LEADER]: Becoming Leader. State: Replica: 91ed915588bf45eb82b602d6f34e9af6, State: Running, Role: LEADER
I20260806 00:53:16.679241 7706 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:16.679275 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 7617
I20260806 00:53:16.679324 7715 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ed915588bf45eb82b602d6f34e9af6" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35135 } }
I20260806 00:53:16.679376 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:16.679558 3466 external_mini_cluster.cc:1428] Setting key 172da3b714d93d92d623b132f1be85ef
I20260806 00:53:16.679708 7717 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91ed915588bf45eb82b602d6f34e9af6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ed915588bf45eb82b602d6f34e9af6" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35135 } } }
I20260806 00:53:16.679832 7717 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:16.679694 7715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91ed915588bf45eb82b602d6f34e9af6. Latest consensus state: current_term: 1 leader_uuid: "91ed915588bf45eb82b602d6f34e9af6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91ed915588bf45eb82b602d6f34e9af6" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35135 } } }
I20260806 00:53:16.680172 7727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:16.680858 7727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:16.680164 7715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:16.682767 7727 catalog_manager.cc:1347] Generated new cluster ID: d470daea4028407c8aef3cb561baf9ae
I20260806 00:53:16.682833 7727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:53:16 dist-test-slave-44d2 krb5kdc[7601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:16.693840 7729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:16.680136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55558 (local address 127.3.98.190:35135)
0806 00:53:16.680556 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:16.680568 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:16.680605 (+ 37us) server_negotiation.cc:407] Connection header received
0806 00:53:16.680743 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:16.680751 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:16.680811 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:16.681812 (+ 1001us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:16.681934 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:16.685203 (+ 3269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:16.686267 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:16.686942 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:16.687082 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:16.689962 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:16.689967 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:16.689967 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:16.689981 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:16.692086 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:16.692473 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:16.692477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:16.692477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:16.692631 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:16.692845 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:16.692846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:16.692847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:16.693174 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:16.693331 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:16.693436 (+ 105us) server_negotiation.cc:299] Negotiation successful
0806 00:53:16.693591 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":79,"threads_started":1}
I20260806 00:53:16.695108 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:53:16.696651 7727 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:16.697386 7727 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:16.705435 7727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91ed915588bf45eb82b602d6f34e9af6: Generated new TSK 0
I20260806 00:53:16.705643 7727 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:53:16.712457 7729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:16.708461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55564 (local address 127.3.98.190:35135)
0806 00:53:16.708581 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:16.708583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:16.708722 (+ 139us) server_negotiation.cc:407] Connection header received
0806 00:53:16.708795 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:16.708796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:16.708806 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:16.708857 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:16.709292 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:16.709810 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:16.710912 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:16.711157 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:16.711211 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:16.711902 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:16.711904 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:16.711904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:16.712153 (+ 249us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:16.712172 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:16.712179 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:16.712227 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:16.712330 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 00:53:16.712358 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 00:53:16.715334 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 7617
2026-08-06T00:53:16Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1535 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:16 dist-test-slave-44d2 krb5kdc[7756](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:16 dist-test-slave-44d2 krb5kdc[7756](info): set up 2 sockets
Aug 06 00:53:16 dist-test-slave-44d2 krb5kdc[7756](info): commencing operation
krb5kdc: starting...
W20260806 00:53:18.007014 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[7756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:53:18.141189 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44343
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:33149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:44343
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:18.226419 7773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:18.226620 7773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:18.226642 7773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:18.227757 7773 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:18.227795 7773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:18.227809 7773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:18.227823 7773 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:18.227834 7773 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:18.229278 7773 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:33149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:44343
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:18.229482 7773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:18.229665 7773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:18.234624 7780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:18.234669 7783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:18.234714 7781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:18.234710 7773 server_base.cc:1034] running on GCE node
I20260806 00:53:18.235183 7773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:18.235433 7773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:18.236651 7773 hybrid_clock.cc:648] HybridClock initialized: now 1785977598236635 us; error 27 us; skew 500 ppm
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[7756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977598, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:18.245013 7773 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:53:18.245565 7773 webserver.cc:460] Webserver started at http://127.3.98.190:37723/ using document root <none> and password file <none>
I20260806 00:53:18.245828 7773 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:18.245900 7773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:18.246055 7773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:18.247190 7773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "a65fa53387fe47938dd9c7b9e5c91d86"
format_stamp: "Formatted at 2026-08-06 00:53:18 on dist-test-slave-44d2"
server_key: "df8d7f190d52da9523ff0e0135492239"
server_key_iv: "1ef5ced50eb0d47f0d0ca5db753360c9"
server_key_version: "encryptionkey@0"
I20260806 00:53:18.247573 7773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "a65fa53387fe47938dd9c7b9e5c91d86"
format_stamp: "Formatted at 2026-08-06 00:53:18 on dist-test-slave-44d2"
server_key: "df8d7f190d52da9523ff0e0135492239"
server_key_iv: "1ef5ced50eb0d47f0d0ca5db753360c9"
server_key_version: "encryptionkey@0"
I20260806 00:53:18.249177 7773 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:18.250065 7793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:18.250270 7773 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:18.250430 7773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "a65fa53387fe47938dd9c7b9e5c91d86"
format_stamp: "Formatted at 2026-08-06 00:53:18 on dist-test-slave-44d2"
server_key: "df8d7f190d52da9523ff0e0135492239"
server_key_iv: "1ef5ced50eb0d47f0d0ca5db753360c9"
server_key_version: "encryptionkey@0"
I20260806 00:53:18.250522 7773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:18.263816 7773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:18.265879 7773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:18.266069 7773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:18.270750 7773 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:44343
I20260806 00:53:18.270787 7865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:44343 every 8 connection(s)
I20260806 00:53:18.271180 7773 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:18.272382 7866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:18.274750 7866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86: Bootstrap starting.
I20260806 00:53:18.275318 7866 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:18.275560 7866 log.cc:824] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:18.276353 7866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86: No bootstrap required, opened a new log
I20260806 00:53:18.276942 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 7773
I20260806 00:53:18.277047 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:18.277230 3466 external_mini_cluster.cc:1428] Setting key f5a755332778f0bf09d5242b1f630813
I20260806 00:53:18.278683 7866 raft_consensus.cc:348] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65fa53387fe47938dd9c7b9e5c91d86" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44343 } }
I20260806 00:53:18.278828 7866 raft_consensus.cc:374] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:18.278851 7866 raft_consensus.cc:729] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a65fa53387fe47938dd9c7b9e5c91d86, State: Initialized, Role: FOLLOWER
I20260806 00:53:18.278980 7866 consensus_queue.cc:260] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65fa53387fe47938dd9c7b9e5c91d86" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44343 } }
I20260806 00:53:18.279057 7866 raft_consensus.cc:388] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:18.279117 7866 raft_consensus.cc:482] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:18.279170 7866 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:18.279961 7866 raft_consensus.cc:504] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65fa53387fe47938dd9c7b9e5c91d86" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44343 } }
I20260806 00:53:18.280097 7866 leader_election.cc:302] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a65fa53387fe47938dd9c7b9e5c91d86; no voters:
I20260806 00:53:18.280275 7866 leader_election.cc:288] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:18.280308 7871 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:18.280431 7871 raft_consensus.cc:686] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [term 1 LEADER]: Becoming Leader. State: Replica: a65fa53387fe47938dd9c7b9e5c91d86, State: Running, Role: LEADER
I20260806 00:53:18.280548 7871 consensus_queue.cc:237] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65fa53387fe47938dd9c7b9e5c91d86" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44343 } }
I20260806 00:53:18.280616 7866 sys_catalog.cc:564] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:18.280943 7873 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a65fa53387fe47938dd9c7b9e5c91d86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65fa53387fe47938dd9c7b9e5c91d86" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44343 } } }
I20260806 00:53:18.281052 7873 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:18.280926 7871 sys_catalog.cc:455] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a65fa53387fe47938dd9c7b9e5c91d86. Latest consensus state: current_term: 1 leader_uuid: "a65fa53387fe47938dd9c7b9e5c91d86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a65fa53387fe47938dd9c7b9e5c91d86" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44343 } } }
I20260806 00:53:18.281287 7871 sys_catalog.cc:458] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:18.281986 7880 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:18.282644 7880 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:18.285600 7880 catalog_manager.cc:1347] Generated new cluster ID: 28b07b3000294222b4f203d9484d666a
I20260806 00:53:18.285662 7880 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[7756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:18.290556 7870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:18.277896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39484 (local address 127.3.98.190:44343)
0806 00:53:18.278087 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:18.278096 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:18.278124 (+ 28us) server_negotiation.cc:407] Connection header received
0806 00:53:18.278973 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:18.278991 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:18.279079 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:18.279261 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:18.280121 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.281635 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.282778 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.283400 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.283579 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:18.286535 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:18.286540 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:18.286540 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:18.286555 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:18.288770 (+ 2215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:18.289215 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:18.289218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:18.289218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:18.289345 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:18.289582 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:18.289583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:18.289583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:18.289891 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:18.290059 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:18.290172 (+ 113us) server_negotiation.cc:299] Negotiation successful
0806 00:53:18.290317 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":73,"threads_started":1}
I20260806 00:53:18.297863 7880 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:18.298405 7880 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:18.304165 7880 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a65fa53387fe47938dd9c7b9e5c91d86: Generated new TSK 0
I20260806 00:53:18.304351 7880 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:53:18.339656 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44343
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:33149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:18.425753 7903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:18.426015 7903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:18.426054 7903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:18.427211 7903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:18.427284 7903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:18.427326 7903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:18.428843 7903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:33149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:18.429138 7903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:18.429375 7903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:18.434538 7909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:18.434687 7910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:18.434687 7913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:18.434928 7903 server_base.cc:1034] running on GCE node
I20260806 00:53:18.435129 7903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:18.435377 7903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:18.436548 7903 hybrid_clock.cc:648] HybridClock initialized: now 1785977598436536 us; error 33 us; skew 500 ppm
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[7756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977598, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:18.439291 7903 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:53:18.439827 7903 webserver.cc:460] Webserver started at http://127.3.98.129:33707/ using document root <none> and password file <none>
I20260806 00:53:18.440101 7903 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:18.440150 7903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:18.440325 7903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:18.441591 7903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "53ac5c5d1c494e12a452491e22bbbf65"
format_stamp: "Formatted at 2026-08-06 00:53:18 on dist-test-slave-44d2"
server_key: "7b0d0236b5dbee8eb2cb027d7bf6cfd6"
server_key_iv: "1705a3183c16d9ad9985a987a47a82b5"
server_key_version: "encryptionkey@0"
I20260806 00:53:18.442008 7903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "53ac5c5d1c494e12a452491e22bbbf65"
format_stamp: "Formatted at 2026-08-06 00:53:18 on dist-test-slave-44d2"
server_key: "7b0d0236b5dbee8eb2cb027d7bf6cfd6"
server_key_iv: "1705a3183c16d9ad9985a987a47a82b5"
server_key_version: "encryptionkey@0"
I20260806 00:53:18.443543 7903 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:18.444351 7924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:18.444633 7903 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:18.444734 7903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "53ac5c5d1c494e12a452491e22bbbf65"
format_stamp: "Formatted at 2026-08-06 00:53:18 on dist-test-slave-44d2"
server_key: "7b0d0236b5dbee8eb2cb027d7bf6cfd6"
server_key_iv: "1705a3183c16d9ad9985a987a47a82b5"
server_key_version: "encryptionkey@0"
I20260806 00:53:18.444793 7903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:18.470517 7903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:18.472626 7903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:18.472748 7903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:18.472957 7903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:18.473304 7903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:18.473337 7903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:18.473393 7903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:18.473420 7903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:18.479766 7903 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:32799
I20260806 00:53:18.479818 8067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:32799 every 8 connection(s)
I20260806 00:53:18.480204 7903 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:53:18.486032 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 7903
I20260806 00:53:18.486157 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:18.486357 3466 external_mini_cluster.cc:1428] Setting key 5127281c9ff1c4a498e1285751dce5fc
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[7756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977598, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:18.491961 7870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:18.481078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:54195 (local address 127.3.98.190:44343)
0806 00:53:18.481130 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:18.481133 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:18.481373 (+ 240us) server_negotiation.cc:407] Connection header received
0806 00:53:18.482072 (+ 699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:18.482074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:18.482084 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:18.482147 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:18.483239 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.483770 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.484874 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.485080 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.485138 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:18.487739 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:18.487741 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:18.487741 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:18.487750 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:18.490213 (+ 2463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:18.490754 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:18.490755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:18.490756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:18.490824 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:18.491155 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:18.491156 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:18.491157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:18.491334 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:18.491410 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:18.491797 (+ 387us) server_negotiation.cc:299] Negotiation successful
0806 00:53:18.491887 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:53:18.492291 8073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:18.481031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44343 (local address 127.3.98.129:54195)
0806 00:53:18.481232 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:18.481281 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:18.481974 (+ 693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:18.482207 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:18.482211 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:18.482916 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:18.483144 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:18.483150 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.483859 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.483860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:18.484794 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:18.484796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.485160 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.485161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:18.485266 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:18.485800 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:18.485812 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:18.487630 (+ 1818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:18.490317 (+ 2687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:18.490327 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:18.490330 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:18.490649 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:18.490907 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:18.490908 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:18.490908 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:18.491077 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:18.491446 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:18.491454 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:18.491636 (+ 182us) client_negotiation.cc:769] Sending connection context
0806 00:53:18.491760 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 00:53:18.491983 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":112,"threads_started":1}
I20260806 00:53:18.493016 8068 heartbeater.cc:347] Connected to a master server at 127.3.98.190:44343
I20260806 00:53:18.493139 8068 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:18.493356 8068 heartbeater.cc:511] Master 127.3.98.190:44343 requested a full tablet report, sending...
I20260806 00:53:18.493927 7820 ts_manager.cc:194] Registered new tserver with Master: 53ac5c5d1c494e12a452491e22bbbf65 (127.3.98.129:32799)
I20260806 00:53:18.494573 7820 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:54195
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:53:18.516314 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44343
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:33149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:18.602185 8077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:18.602552 8077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:18.602600 8077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:18.603873 8077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:18.603950 8077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:18.604001 8077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:18.605676 8077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:33149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:18.605985 8077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:18.606253 8077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:18.611614 8083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:18.611652 8085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:18.611662 8091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:18.612011 8077 server_base.cc:1034] running on GCE node
I20260806 00:53:18.612236 8077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:18.612532 8077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:18.613713 8077 hybrid_clock.cc:648] HybridClock initialized: now 1785977598613694 us; error 36 us; skew 500 ppm
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[7756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977598, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:18.616338 8077 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:53:18.616844 8077 webserver.cc:460] Webserver started at http://127.3.98.130:45015/ using document root <none> and password file <none>
I20260806 00:53:18.617089 8077 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:18.617161 8077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:18.617336 8077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:18.618445 8077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "e3491054867a4277b97426138e7263c5"
format_stamp: "Formatted at 2026-08-06 00:53:18 on dist-test-slave-44d2"
server_key: "4fd3ba65a9182f22fc64c045b17a7895"
server_key_iv: "52d4cb38563342c274ea98d297b29161"
server_key_version: "encryptionkey@0"
I20260806 00:53:18.618832 8077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "e3491054867a4277b97426138e7263c5"
format_stamp: "Formatted at 2026-08-06 00:53:18 on dist-test-slave-44d2"
server_key: "4fd3ba65a9182f22fc64c045b17a7895"
server_key_iv: "52d4cb38563342c274ea98d297b29161"
server_key_version: "encryptionkey@0"
I20260806 00:53:18.620175 8077 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:53:18.620985 8099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:18.621162 8077 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:18.621270 8077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "e3491054867a4277b97426138e7263c5"
format_stamp: "Formatted at 2026-08-06 00:53:18 on dist-test-slave-44d2"
server_key: "4fd3ba65a9182f22fc64c045b17a7895"
server_key_iv: "52d4cb38563342c274ea98d297b29161"
server_key_version: "encryptionkey@0"
I20260806 00:53:18.621345 8077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:18.634310 8077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:18.636173 8077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:18.636338 8077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:18.636657 8077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:18.636988 8077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:18.637043 8077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:18.637086 8077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:18.637113 8077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:18.643368 8077 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:40419
I20260806 00:53:18.643421 8256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:40419 every 8 connection(s)
I20260806 00:53:18.643810 8077 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[7756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977598, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:18.652380 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 8077
I20260806 00:53:18.652518 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:18.652747 3466 external_mini_cluster.cc:1428] Setting key 65f9904f83320508d64eea6f9b5052bf
I20260806 00:53:18.656265 7870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:18.644628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:35733 (local address 127.3.98.190:44343)
0806 00:53:18.644704 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:18.644707 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:18.644973 (+ 266us) server_negotiation.cc:407] Connection header received
0806 00:53:18.645503 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:18.645505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:18.645518 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:18.645606 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:18.646654 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.647176 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.648296 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.648603 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.648673 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:18.651778 (+ 3105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:18.651780 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:18.651780 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:18.651789 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:18.654350 (+ 2561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:18.655149 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:18.655150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:18.655151 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:18.655225 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:18.655536 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:18.655537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:18.655537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:18.655703 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:18.655779 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:18.656042 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 00:53:18.656138 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 00:53:18.656298 8260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:18.644641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44343 (local address 127.3.98.130:35733)
0806 00:53:18.644840 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:18.644878 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:18.645393 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:18.645686 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:18.645689 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:18.646341 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:18.646550 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:18.646555 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.647306 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.647307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:18.648195 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:18.648197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.648679 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.648681 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:18.648812 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:18.649720 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:18.649731 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:18.651643 (+ 1912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:18.654440 (+ 2797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:18.654449 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:18.654452 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:18.655004 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:18.655301 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:18.655302 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:18.655302 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:18.655457 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:18.655780 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:18.655786 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:18.655908 (+ 122us) client_negotiation.cc:769] Sending connection context
0806 00:53:18.655996 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 00:53:18.656132 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":95,"threads_started":1}
I20260806 00:53:18.656776 8257 heartbeater.cc:347] Connected to a master server at 127.3.98.190:44343
I20260806 00:53:18.656876 8257 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:18.657089 8257 heartbeater.cc:511] Master 127.3.98.190:44343 requested a full tablet report, sending...
I20260806 00:53:18.657473 7820 ts_manager.cc:194] Registered new tserver with Master: e3491054867a4277b97426138e7263c5 (127.3.98.130:40419)
I20260806 00:53:18.657852 7820 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:35733
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:53:18.681818 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44343
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:33149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:18.765954 8264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:18.766211 8264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:18.766255 8264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:18.767493 8264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:18.767562 8264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:18.767620 8264 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:18.769138 8264 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:33149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8264
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:18.769424 8264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:18.769667 8264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:18.774919 8272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:18.774936 8273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:18.775069 8275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:18.775223 8264 server_base.cc:1034] running on GCE node
I20260806 00:53:18.775636 8264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:18.775872 8264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:18.777019 8264 hybrid_clock.cc:648] HybridClock initialized: now 1785977598776989 us; error 46 us; skew 500 ppm
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[7756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977598, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:18.779532 8264 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:53:18.779915 8264 webserver.cc:460] Webserver started at http://127.3.98.131:44129/ using document root <none> and password file <none>
I20260806 00:53:18.780119 8264 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:18.780184 8264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:18.780346 8264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:18.781612 8264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "117ff24ae9844b3982c115ac66ce423b"
format_stamp: "Formatted at 2026-08-06 00:53:18 on dist-test-slave-44d2"
server_key: "105a35c71de790e0289931066b8ce5fc"
server_key_iv: "edb67723c6efdb4dea6ec7c5b4c37e28"
server_key_version: "encryptionkey@0"
I20260806 00:53:18.781987 8264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "117ff24ae9844b3982c115ac66ce423b"
format_stamp: "Formatted at 2026-08-06 00:53:18 on dist-test-slave-44d2"
server_key: "105a35c71de790e0289931066b8ce5fc"
server_key_iv: "edb67723c6efdb4dea6ec7c5b4c37e28"
server_key_version: "encryptionkey@0"
I20260806 00:53:18.783442 8264 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:18.784181 8285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:18.784356 8264 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:18.784448 8264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "117ff24ae9844b3982c115ac66ce423b"
format_stamp: "Formatted at 2026-08-06 00:53:18 on dist-test-slave-44d2"
server_key: "105a35c71de790e0289931066b8ce5fc"
server_key_iv: "edb67723c6efdb4dea6ec7c5b4c37e28"
server_key_version: "encryptionkey@0"
I20260806 00:53:18.784567 8264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:18.803373 8264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:18.805691 8264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:18.805858 8264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:18.806108 8264 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:18.806438 8264 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:18.806475 8264 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:18.806520 8264 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:18.806550 8264 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:18.813184 8264 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:45769
I20260806 00:53:18.813271 8443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:45769 every 8 connection(s)
I20260806 00:53:18.813784 8264 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:18.817538 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 8264
I20260806 00:53:18.817618 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:18.817812 3466 external_mini_cluster.cc:1428] Setting key 3a701fed37cdbaca02b31b2c41a6cfd6
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[7756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977598, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:18.823364 7870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:18.814720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:57163 (local address 127.3.98.190:44343)
0806 00:53:18.814780 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:18.814782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:18.814971 (+ 189us) server_negotiation.cc:407] Connection header received
0806 00:53:18.815475 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:18.815476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:18.815487 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:18.815553 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:18.816624 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.817165 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.818386 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.818602 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.818678 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:18.820937 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:18.820938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:18.820938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:18.820945 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:18.822177 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:18.822550 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:18.822551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:18.822551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:18.822603 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:18.822826 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:18.822827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:18.822827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:18.822928 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:18.822996 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:18.823231 (+ 235us) server_negotiation.cc:299] Negotiation successful
0806 00:53:18.823296 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 00:53:18.823611 8448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:18.814664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44343 (local address 127.3.98.131:57163)
0806 00:53:18.814831 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:18.814875 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:18.815360 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:18.815644 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:18.815648 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:18.816238 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:18.816440 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:18.816445 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.817248 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.817249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:18.818310 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:18.818314 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.818696 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.818698 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:18.818843 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:18.819406 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:18.819414 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:18.820847 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:18.822252 (+ 1405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:18.822258 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:18.822260 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:18.822482 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:18.822662 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:18.822663 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:18.822663 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:18.822772 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:18.822989 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:18.822993 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:18.823119 (+ 126us) client_negotiation.cc:769] Sending connection context
0806 00:53:18.823204 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 00:53:18.823328 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":94,"threads_started":1}
I20260806 00:53:18.824090 8444 heartbeater.cc:347] Connected to a master server at 127.3.98.190:44343
I20260806 00:53:18.824198 8444 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:18.824369 8444 heartbeater.cc:511] Master 127.3.98.190:44343 requested a full tablet report, sending...
I20260806 00:53:18.824810 7820 ts_manager.cc:194] Registered new tserver with Master: 117ff24ae9844b3982c115ac66ce423b (127.3.98.131:45769)
I20260806 00:53:18.825196 7820 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:57163
I20260806 00:53:18.829512 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[7756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977598, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[7756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977598, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:18.854652 7870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:18.847022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39492 (local address 127.3.98.190:44343)
0806 00:53:18.847091 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:18.847093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:18.847224 (+ 131us) server_negotiation.cc:407] Connection header received
0806 00:53:18.847326 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:18.847328 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:18.847340 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:18.847415 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:18.848125 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.848691 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.849411 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:18.849600 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:18.849653 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:18.851868 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:18.851869 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:18.851869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:18.851877 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:18.853407 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:18.853725 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:18.853726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:18.853726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:18.853783 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:18.853954 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:18.853954 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:18.853954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:18.854114 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:18.854193 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:18.854462 (+ 269us) server_negotiation.cc:299] Negotiation successful
0806 00:53:18.854539 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260806 00:53:18.854938 7820 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:39492
I20260806 00:53:18.855432 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 7903
I20260806 00:53:18.873811 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 8077
I20260806 00:53:18.889292 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 8264
I20260806 00:53:18.897300 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 7773
2026-08-06T00:53:18Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2180 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[8462](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[8462](info): set up 2 sockets
Aug 06 00:53:18 dist-test-slave-44d2 krb5kdc[8462](info): commencing operation
krb5kdc: starting...
W20260806 00:53:20.139952 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.216s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:20 dist-test-slave-44d2 krb5kdc[8462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:53:20.271407 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:45561
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:45561
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:20.357810 8479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:20.358098 8479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:20.358141 8479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:20.359334 8479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:20.359416 8479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:20.359444 8479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:20.359467 8479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:20.359503 8479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:20.361122 8479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:45561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:45561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:20.361460 8479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:20.361729 8479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:20.366953 8487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:20.366993 8489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:20.366954 8491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:20.367588 8479 server_base.cc:1034] running on GCE node
I20260806 00:53:20.367961 8479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:20.368287 8479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:20.369488 8479 hybrid_clock.cc:648] HybridClock initialized: now 1785977600369444 us; error 55 us; skew 500 ppm
Aug 06 00:53:20 dist-test-slave-44d2 krb5kdc[8462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977600, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:20.372131 8479 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:53:20.372622 8479 webserver.cc:460] Webserver started at http://127.3.98.190:37797/ using document root <none> and password file <none>
I20260806 00:53:20.372823 8479 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:20.372865 8479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:20.372961 8479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:20.373987 8479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "4112ae8e226249d38b1abb59001c2b5c"
format_stamp: "Formatted at 2026-08-06 00:53:20 on dist-test-slave-44d2"
server_key: "dca40195f02165f0d6c40d879fff890a"
server_key_iv: "8e14f987f2bf17fbdbf8c0520fcffdb5"
server_key_version: "encryptionkey@0"
I20260806 00:53:20.374389 8479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "4112ae8e226249d38b1abb59001c2b5c"
format_stamp: "Formatted at 2026-08-06 00:53:20 on dist-test-slave-44d2"
server_key: "dca40195f02165f0d6c40d879fff890a"
server_key_iv: "8e14f987f2bf17fbdbf8c0520fcffdb5"
server_key_version: "encryptionkey@0"
I20260806 00:53:20.375757 8479 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:20.376554 8501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:20.376729 8479 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:20.376822 8479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "4112ae8e226249d38b1abb59001c2b5c"
format_stamp: "Formatted at 2026-08-06 00:53:20 on dist-test-slave-44d2"
server_key: "dca40195f02165f0d6c40d879fff890a"
server_key_iv: "8e14f987f2bf17fbdbf8c0520fcffdb5"
server_key_version: "encryptionkey@0"
I20260806 00:53:20.376878 8479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:20.391798 8479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:20.394189 8479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:20.394304 8479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:20.398329 8479 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:45561
I20260806 00:53:20.398394 8568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:45561 every 8 connection(s)
I20260806 00:53:20.398940 8479 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:20.399712 8570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:20.402210 8570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c: Bootstrap starting.
I20260806 00:53:20.402876 8570 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:20.403216 8570 log.cc:824] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:20.403962 8570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c: No bootstrap required, opened a new log
I20260806 00:53:20.405718 8570 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4112ae8e226249d38b1abb59001c2b5c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45561 } }
I20260806 00:53:20.405890 8570 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:20.405941 8570 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4112ae8e226249d38b1abb59001c2b5c, State: Initialized, Role: FOLLOWER
I20260806 00:53:20.406092 8570 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4112ae8e226249d38b1abb59001c2b5c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45561 } }
I20260806 00:53:20.406178 8570 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:20.406224 8570 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:20.406277 8570 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:20.407122 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 8479
I20260806 00:53:20.407232 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:20.407442 3466 external_mini_cluster.cc:1428] Setting key f68e2bbfda0b4fdafcee27adb5d5a320
I20260806 00:53:20.407444 8570 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4112ae8e226249d38b1abb59001c2b5c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45561 } }
I20260806 00:53:20.407559 8570 leader_election.cc:302] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4112ae8e226249d38b1abb59001c2b5c; no voters:
I20260806 00:53:20.407760 8570 leader_election.cc:288] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:20.407799 8574 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:20.407929 8574 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [term 1 LEADER]: Becoming Leader. State: Replica: 4112ae8e226249d38b1abb59001c2b5c, State: Running, Role: LEADER
I20260806 00:53:20.408015 8574 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4112ae8e226249d38b1abb59001c2b5c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45561 } }
I20260806 00:53:20.408044 8570 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:20.408339 8577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4112ae8e226249d38b1abb59001c2b5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4112ae8e226249d38b1abb59001c2b5c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45561 } } }
I20260806 00:53:20.408339 8574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4112ae8e226249d38b1abb59001c2b5c. Latest consensus state: current_term: 1 leader_uuid: "4112ae8e226249d38b1abb59001c2b5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4112ae8e226249d38b1abb59001c2b5c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45561 } } }
I20260806 00:53:20.408593 8577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:20.408617 8574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:20.409344 8589 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:20.410168 8589 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:20.411834 8589 catalog_manager.cc:1347] Generated new cluster ID: 3261ab019631492091486515aec72adb
I20260806 00:53:20.411895 8589 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:53:20 dist-test-slave-44d2 krb5kdc[8462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:20.419525 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:20.407975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58610 (local address 127.3.98.190:45561)
0806 00:53:20.408299 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:20.408310 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:20.408346 (+ 36us) server_negotiation.cc:407] Connection header received
0806 00:53:20.408472 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:20.408506 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:20.408574 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:20.409314 (+ 740us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:20.409806 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.411077 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.411982 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.412621 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.412720 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:20.415605 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:20.415610 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:20.415610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:20.415623 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:20.417848 (+ 2225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:20.418242 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:20.418245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:20.418246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:20.418378 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:20.418601 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:20.418602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:20.418602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:20.418925 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:20.419086 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:20.419178 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 00:53:20.419322 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":81,"threads_started":1}
I20260806 00:53:20.429592 8589 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:20.430078 8589 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:20.438778 8589 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4112ae8e226249d38b1abb59001c2b5c: Generated new TSK 0
I20260806 00:53:20.439038 8589 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:53:20.469640 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:45561
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:20.554834 8607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:20.555025 8607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:20.555052 8607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:20.556125 8607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:20.556159 8607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:20.556185 8607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:20.557660 8607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:45561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:20.557861 8607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:20.558050 8607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:20.563351 8619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:20.563426 8616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:20.563352 8614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:20.563771 8607 server_base.cc:1034] running on GCE node
I20260806 00:53:20.563985 8607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:20.564208 8607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:20.565352 8607 hybrid_clock.cc:648] HybridClock initialized: now 1785977600565338 us; error 31 us; skew 500 ppm
Aug 06 00:53:20 dist-test-slave-44d2 krb5kdc[8462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977600, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:20.567962 8607 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:53:20.568414 8607 webserver.cc:460] Webserver started at http://127.3.98.129:43563/ using document root <none> and password file <none>
I20260806 00:53:20.568691 8607 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:20.568742 8607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:20.568929 8607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:20.570019 8607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "ea3f12c3d3694341b84940505f5dde53"
format_stamp: "Formatted at 2026-08-06 00:53:20 on dist-test-slave-44d2"
server_key: "0fe88ffa1dc770c06d96986fa3705f0f"
server_key_iv: "56c4ef8d9f2375ee3febb48fe85e0c8e"
server_key_version: "encryptionkey@0"
I20260806 00:53:20.570418 8607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "ea3f12c3d3694341b84940505f5dde53"
format_stamp: "Formatted at 2026-08-06 00:53:20 on dist-test-slave-44d2"
server_key: "0fe88ffa1dc770c06d96986fa3705f0f"
server_key_iv: "56c4ef8d9f2375ee3febb48fe85e0c8e"
server_key_version: "encryptionkey@0"
I20260806 00:53:20.571794 8607 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:20.572604 8626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:20.572785 8607 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:20.572887 8607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "ea3f12c3d3694341b84940505f5dde53"
format_stamp: "Formatted at 2026-08-06 00:53:20 on dist-test-slave-44d2"
server_key: "0fe88ffa1dc770c06d96986fa3705f0f"
server_key_iv: "56c4ef8d9f2375ee3febb48fe85e0c8e"
server_key_version: "encryptionkey@0"
I20260806 00:53:20.572969 8607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:20.587378 8607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:20.589362 8607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:20.589524 8607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:20.589772 8607 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:20.590111 8607 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:20.590166 8607 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:20.590212 8607 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:20.590245 8607 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:20.596247 8607 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:45433
I20260806 00:53:20.596303 8778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:45433 every 8 connection(s)
I20260806 00:53:20.596644 8607 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
Aug 06 00:53:20 dist-test-slave-44d2 krb5kdc[8462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977600, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:20.605446 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 8607
I20260806 00:53:20.605587 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:20.605852 3466 external_mini_cluster.cc:1428] Setting key 25c2a5d037ed5aea47bcb245895a7525
I20260806 00:53:20.606388 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:20.597379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:34857 (local address 127.3.98.190:45561)
0806 00:53:20.597427 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:20.597429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:20.597627 (+ 198us) server_negotiation.cc:407] Connection header received
0806 00:53:20.598568 (+ 941us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:20.598568 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:20.598583 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:20.598635 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:20.599228 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.599732 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.600819 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.601023 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.601079 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:20.603427 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:20.603429 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:20.603429 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:20.603436 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:20.604804 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:20.605177 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:20.605178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:20.605178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:20.605231 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:20.605575 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:20.605576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:20.605577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:20.605737 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:20.605792 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:20.606200 (+ 408us) server_negotiation.cc:299] Negotiation successful
0806 00:53:20.606300 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:53:20.606575 8782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:20.597351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:45561 (local address 127.3.98.129:34857)
0806 00:53:20.597508 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:20.597544 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:20.598450 (+ 906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:20.598691 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:20.598695 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:20.598952 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:20.599148 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:20.599152 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.599815 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.599816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:20.600740 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:20.600743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.601100 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.601101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:20.601205 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:20.601864 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:20.601874 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:20.603330 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:20.604876 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:20.604883 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:20.604885 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:20.605111 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:20.605306 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:20.605307 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:20.605308 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:20.605466 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:20.605804 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:20.605811 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:20.605994 (+ 183us) client_negotiation.cc:769] Sending connection context
0806 00:53:20.606132 (+ 138us) client_negotiation.cc:240] Negotiation successful
0806 00:53:20.606339 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":90,"threads_started":1}
I20260806 00:53:20.607065 8779 heartbeater.cc:347] Connected to a master server at 127.3.98.190:45561
I20260806 00:53:20.607177 8779 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:20.607432 8779 heartbeater.cc:511] Master 127.3.98.190:45561 requested a full tablet report, sending...
I20260806 00:53:20.607967 8523 ts_manager.cc:194] Registered new tserver with Master: ea3f12c3d3694341b84940505f5dde53 (127.3.98.129:45433)
I20260806 00:53:20.608778 8523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:34857
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:53:20.632966 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:45561
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:20.720916 8788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:20.721145 8788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:20.721170 8788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:20.722311 8788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:20.722352 8788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:20.722379 8788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:20.724004 8788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:45561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:20.724246 8788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:20.724475 8788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:20.729714 8797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:20.729765 8796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:20.729733 8788 server_base.cc:1034] running on GCE node
W20260806 00:53:20.729733 8799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:20.730118 8788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:20.730376 8788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:20.731549 8788 hybrid_clock.cc:648] HybridClock initialized: now 1785977600731556 us; error 51 us; skew 500 ppm
Aug 06 00:53:20 dist-test-slave-44d2 krb5kdc[8462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977600, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:20.734249 8788 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:53:20.734752 8788 webserver.cc:460] Webserver started at http://127.3.98.130:35821/ using document root <none> and password file <none>
I20260806 00:53:20.734942 8788 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:20.734983 8788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:20.735077 8788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:20.736111 8788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "e28d78fa24c045cca6c426fc5550895c"
format_stamp: "Formatted at 2026-08-06 00:53:20 on dist-test-slave-44d2"
server_key: "c601534962bbdb9d3852e57b27cf4f57"
server_key_iv: "8414414e23d228adea861de576b8b450"
server_key_version: "encryptionkey@0"
I20260806 00:53:20.736426 8788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "e28d78fa24c045cca6c426fc5550895c"
format_stamp: "Formatted at 2026-08-06 00:53:20 on dist-test-slave-44d2"
server_key: "c601534962bbdb9d3852e57b27cf4f57"
server_key_iv: "8414414e23d228adea861de576b8b450"
server_key_version: "encryptionkey@0"
I20260806 00:53:20.737782 8788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:20.738478 8810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:20.738669 8788 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:20.738755 8788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "e28d78fa24c045cca6c426fc5550895c"
format_stamp: "Formatted at 2026-08-06 00:53:20 on dist-test-slave-44d2"
server_key: "c601534962bbdb9d3852e57b27cf4f57"
server_key_iv: "8414414e23d228adea861de576b8b450"
server_key_version: "encryptionkey@0"
I20260806 00:53:20.738809 8788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:20.747536 8788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:20.749434 8788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:20.749548 8788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:20.749738 8788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:20.750006 8788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:20.750038 8788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:20.750059 8788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:20.750072 8788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:20.755678 8788 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:45453
I20260806 00:53:20.755761 8965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:45453 every 8 connection(s)
I20260806 00:53:20.756081 8788 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:20.758153 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 8788
I20260806 00:53:20.758272 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:20.758466 3466 external_mini_cluster.cc:1428] Setting key ec2b79634891f1b71278cf510de5657d
Aug 06 00:53:20 dist-test-slave-44d2 krb5kdc[8462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977600, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:20.766168 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:20.756833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:54795 (local address 127.3.98.190:45561)
0806 00:53:20.756899 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:20.756902 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:20.757105 (+ 203us) server_negotiation.cc:407] Connection header received
0806 00:53:20.758045 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:20.758046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:20.758061 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:20.758126 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:20.758996 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.759530 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.760581 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.760811 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.760904 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:20.763150 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:20.763152 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:20.763152 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:20.763161 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:20.764707 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:20.765142 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:20.765143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:20.765144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:20.765209 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:20.765479 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:20.765480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:20.765480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:20.765610 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:20.765686 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:20.765980 (+ 294us) server_negotiation.cc:299] Negotiation successful
0806 00:53:20.766072 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 00:53:20.766386 8968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:20.756804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:45561 (local address 127.3.98.130:54795)
0806 00:53:20.756976 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:20.757017 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:20.757923 (+ 906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:20.758214 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:20.758219 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:20.758616 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:20.758893 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:20.758899 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.759641 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.759642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:20.760460 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:20.760462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.760916 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.760917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:20.761059 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:20.761626 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:20.761635 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:20.763034 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:20.764810 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:20.764817 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:20.764819 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:20.765054 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:20.765284 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:20.765284 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:20.765285 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:20.765403 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:20.765688 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:20.765695 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:20.765838 (+ 143us) client_negotiation.cc:769] Sending connection context
0806 00:53:20.765944 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 00:53:20.766126 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260806 00:53:20.766935 8966 heartbeater.cc:347] Connected to a master server at 127.3.98.190:45561
I20260806 00:53:20.767026 8966 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:20.767234 8966 heartbeater.cc:511] Master 127.3.98.190:45561 requested a full tablet report, sending...
I20260806 00:53:20.767647 8523 ts_manager.cc:194] Registered new tserver with Master: e28d78fa24c045cca6c426fc5550895c (127.3.98.130:45453)
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
I20260806 00:53:20.768157 8523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:54795
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:53:20.787056 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:45561
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:46227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:20.872273 8974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:20.872531 8974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:20.872555 8974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:20.873674 8974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:20.873709 8974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:20.873735 8974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:20.875259 8974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:46227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:45561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:20.875459 8974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:20.875627 8974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:20.880877 8981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:20.880944 8984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:20.880999 8974 server_base.cc:1034] running on GCE node
W20260806 00:53:20.880851 8980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:20.881240 8974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:20.881520 8974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:20.882675 8974 hybrid_clock.cc:648] HybridClock initialized: now 1785977600882663 us; error 29 us; skew 500 ppm
Aug 06 00:53:20 dist-test-slave-44d2 krb5kdc[8462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977600, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:20.885335 8974 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:53:20.885828 8974 webserver.cc:460] Webserver started at http://127.3.98.131:36729/ using document root <none> and password file <none>
I20260806 00:53:20.886063 8974 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:20.886111 8974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:20.886286 8974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:20.887365 8974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "d362b2d262484c7580b12adc314fc4e6"
format_stamp: "Formatted at 2026-08-06 00:53:20 on dist-test-slave-44d2"
server_key: "69542235497ea5ca3debd7643261f35b"
server_key_iv: "f6f29359298e663abd60249c8766e2d2"
server_key_version: "encryptionkey@0"
I20260806 00:53:20.887745 8974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "d362b2d262484c7580b12adc314fc4e6"
format_stamp: "Formatted at 2026-08-06 00:53:20 on dist-test-slave-44d2"
server_key: "69542235497ea5ca3debd7643261f35b"
server_key_iv: "f6f29359298e663abd60249c8766e2d2"
server_key_version: "encryptionkey@0"
I20260806 00:53:20.889348 8974 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:20.890125 8991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:20.890306 8974 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:20.890424 8974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "d362b2d262484c7580b12adc314fc4e6"
format_stamp: "Formatted at 2026-08-06 00:53:20 on dist-test-slave-44d2"
server_key: "69542235497ea5ca3debd7643261f35b"
server_key_iv: "f6f29359298e663abd60249c8766e2d2"
server_key_version: "encryptionkey@0"
I20260806 00:53:20.890542 8974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:20.901208 8974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:20.903581 8974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:20.903748 8974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:20.903985 8974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:20.904301 8974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:20.904357 8974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:20.904443 8974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:20.904502 8974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:20.911228 8974 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:37607
I20260806 00:53:20.911264 9151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:37607 every 8 connection(s)
I20260806 00:53:20.911623 8974 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:20.912720 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 8974
I20260806 00:53:20.912827 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:20.913053 3466 external_mini_cluster.cc:1428] Setting key 437e081f63548fe017c1fd4e184bd971
Aug 06 00:53:20 dist-test-slave-44d2 krb5kdc[8462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977600, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:20.921815 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:20.912394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:53287 (local address 127.3.98.190:45561)
0806 00:53:20.912439 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:20.912441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:20.912735 (+ 294us) server_negotiation.cc:407] Connection header received
0806 00:53:20.913999 (+ 1264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:20.914000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:20.914015 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:20.914066 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:20.914712 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.915214 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.916233 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.916435 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.916545 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:20.918727 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:20.918729 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:20.918729 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:20.918737 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:20.920206 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:20.920751 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:20.920752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:20.920753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:20.920820 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:20.921108 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:20.921109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:20.921110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:20.921238 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:20.921320 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:20.921622 (+ 302us) server_negotiation.cc:299] Negotiation successful
0806 00:53:20.921721 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 00:53:20.922003 9155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:20.912358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:45561 (local address 127.3.98.131:53287)
0806 00:53:20.912589 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:20.912635 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:20.913887 (+ 1252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:20.914143 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:20.914148 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:20.914406 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:20.914604 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:20.914609 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.915307 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.915309 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:20.916135 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:20.916137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.916556 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.916557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:20.916698 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:20.917245 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:20.917255 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:20.918625 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:20.920314 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:20.920322 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:20.920324 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:20.920642 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:20.920891 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:20.920892 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:20.920892 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:20.921020 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:20.921308 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:20.921315 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:20.921466 (+ 151us) client_negotiation.cc:769] Sending connection context
0806 00:53:20.921576 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 00:53:20.921748 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":151,"threads_started":1}
I20260806 00:53:20.922547 9152 heartbeater.cc:347] Connected to a master server at 127.3.98.190:45561
I20260806 00:53:20.922669 9152 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:20.922875 9152 heartbeater.cc:511] Master 127.3.98.190:45561 requested a full tablet report, sending...
I20260806 00:53:20.923411 8523 ts_manager.cc:194] Registered new tserver with Master: d362b2d262484c7580b12adc314fc4e6 (127.3.98.131:37607)
I20260806 00:53:20.923959 8523 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:53287
I20260806 00:53:20.925151 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 00:53:20 dist-test-slave-44d2 krb5kdc[8462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 00:53:20 dist-test-slave-44d2 krb5kdc[8462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.129@KRBTEST.COM
I20260806 00:53:20.952440 9162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:20.944400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59838 (local address 127.3.98.129:45433)
0806 00:53:20.944629 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:20.944639 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:20.944651 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:53:20.944680 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:20.944682 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:20.944696 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:20.944771 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:20.945351 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.946107 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.946904 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.947279 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.947369 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:20.949754 (+ 2385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:20.949764 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:20.949765 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:20.949775 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:20.951221 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:20.951589 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:20.951595 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:20.951595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:20.951655 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:20.951856 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:20.951857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:20.951858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:20.952008 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:20.952180 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:20.952225 (+ 45us) server_negotiation.cc:299] Negotiation successful
0806 00:53:20.952308 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":144,"threads_started":1}
Aug 06 00:53:20 dist-test-slave-44d2 krb5kdc[8462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:20.960789 8582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:20.953883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58618 (local address 127.3.98.190:45561)
0806 00:53:20.953960 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:20.953962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:20.953972 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:20.954003 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:20.954004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:20.954022 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:20.954087 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:20.954579 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.955074 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.955767 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:20.955958 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:20.956035 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:20.958293 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:20.958295 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:20.958295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:20.958303 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:20.959722 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:20.960032 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:20.960033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:20.960033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:20.960100 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:20.960265 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:20.960266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:20.960266 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:20.960422 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:20.960585 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:20.960652 (+ 67us) server_negotiation.cc:299] Negotiation successful
0806 00:53:20.960718 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260806 00:53:20.961088 8523 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58618
I20260806 00:53:20.961503 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 8607
I20260806 00:53:20.973810 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 8788
I20260806 00:53:20.984134 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 8974
I20260806 00:53:20.995450 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 8479
2026-08-06T00:53:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2096 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:21 dist-test-slave-44d2 krb5kdc[9169](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:21 dist-test-slave-44d2 krb5kdc[9169](info): set up 2 sockets
Aug 06 00:53:21 dist-test-slave-44d2 krb5kdc[9169](info): commencing operation
krb5kdc: starting...
W20260806 00:53:22.309429 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.288s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:22 dist-test-slave-44d2 krb5kdc[9169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:53:22.439785 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:41325
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:32951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:41325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:22.524236 9185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:22.524573 9185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:22.524609 9185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:22.525771 9185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:22.525810 9185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:22.525825 9185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:22.525837 9185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:22.525849 9185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:22.527349 9185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:32951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:41325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:41325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:22.527560 9185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:22.527751 9185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:22.533000 9192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:22.533109 9191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:22.533000 9194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:22.533486 9185 server_base.cc:1034] running on GCE node
I20260806 00:53:22.533780 9185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:22.534089 9185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:22.535265 9185 hybrid_clock.cc:648] HybridClock initialized: now 1785977602535218 us; error 80 us; skew 500 ppm
Aug 06 00:53:22 dist-test-slave-44d2 krb5kdc[9169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977602, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:22.538057 9185 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:53:22.538492 9185 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:22.538566 9185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:22.538726 9185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:22.539933 9185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "7d961107207441bb8a97e64f8bc38cec"
format_stamp: "Formatted at 2026-08-06 00:53:22 on dist-test-slave-44d2"
server_key: "eab6b681223f020f6903d49e42dd4b6c"
server_key_iv: "353ddbddf8ab581361d6eeafda82a9ea"
server_key_version: "encryptionkey@0"
I20260806 00:53:22.540366 9185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "7d961107207441bb8a97e64f8bc38cec"
format_stamp: "Formatted at 2026-08-06 00:53:22 on dist-test-slave-44d2"
server_key: "eab6b681223f020f6903d49e42dd4b6c"
server_key_iv: "353ddbddf8ab581361d6eeafda82a9ea"
server_key_version: "encryptionkey@0"
I20260806 00:53:22.541780 9185 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:22.542600 9203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:22.542796 9185 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:22.542908 9185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "7d961107207441bb8a97e64f8bc38cec"
format_stamp: "Formatted at 2026-08-06 00:53:22 on dist-test-slave-44d2"
server_key: "eab6b681223f020f6903d49e42dd4b6c"
server_key_iv: "353ddbddf8ab581361d6eeafda82a9ea"
server_key_version: "encryptionkey@0"
I20260806 00:53:22.542984 9185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:22.567509 9185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:22.570160 9185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:22.570345 9185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:22.575138 9185 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:41325
I20260806 00:53:22.575201 9275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:41325 every 8 connection(s)
I20260806 00:53:22.575533 9185 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:22.576681 9276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:22.579061 9276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec: Bootstrap starting.
I20260806 00:53:22.579721 9276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:22.580040 9276 log.cc:824] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:22.580804 9276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec: No bootstrap required, opened a new log
I20260806 00:53:22.582535 9276 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d961107207441bb8a97e64f8bc38cec" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41325 } }
I20260806 00:53:22.582696 9276 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:22.582744 9276 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d961107207441bb8a97e64f8bc38cec, State: Initialized, Role: FOLLOWER
I20260806 00:53:22.582913 9276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d961107207441bb8a97e64f8bc38cec" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41325 } }
I20260806 00:53:22.582998 9276 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:22.583042 9276 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:22.583118 9276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:22.583959 9276 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d961107207441bb8a97e64f8bc38cec" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41325 } }
I20260806 00:53:22.584080 9276 leader_election.cc:302] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d961107207441bb8a97e64f8bc38cec; no voters:
I20260806 00:53:22.584265 9276 leader_election.cc:288] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:22.584313 9279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:22.584570 9276 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:22.584547 9279 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [term 1 LEADER]: Becoming Leader. State: Replica: 7d961107207441bb8a97e64f8bc38cec, State: Running, Role: LEADER
I20260806 00:53:22.584710 9279 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d961107207441bb8a97e64f8bc38cec" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41325 } }
I20260806 00:53:22.585093 9283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d961107207441bb8a97e64f8bc38cec. Latest consensus state: current_term: 1 leader_uuid: "7d961107207441bb8a97e64f8bc38cec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d961107207441bb8a97e64f8bc38cec" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41325 } } }
I20260806 00:53:22.585187 9283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:22.585083 9282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d961107207441bb8a97e64f8bc38cec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d961107207441bb8a97e64f8bc38cec" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41325 } } }
I20260806 00:53:22.585377 9282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:22.585485 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 9185
I20260806 00:53:22.585601 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:22.585776 9292 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:22.585794 3466 external_mini_cluster.cc:1428] Setting key c09c9cab081528254329feb468f76146
I20260806 00:53:22.586505 9292 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:22.588021 9292 catalog_manager.cc:1347] Generated new cluster ID: 95e73966d85d4ef7a704bd7d60ef4392
I20260806 00:53:22.588081 9292 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:53:22 dist-test-slave-44d2 krb5kdc[9169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:22.597744 9310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:22.586338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56830 (local address 127.3.98.190:41325)
0806 00:53:22.586525 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:22.586536 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:22.588708 (+ 2172us) server_negotiation.cc:407] Connection header received
0806 00:53:22.588841 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:22.588847 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:22.588890 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:22.589031 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:22.589671 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:22.590581 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:22.591356 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:22.591804 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:22.591938 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:22.594337 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:22.594340 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:22.594341 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:22.594353 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:22.596085 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:22.596522 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:22.596529 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:22.596530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:22.596619 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:22.596852 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:22.596853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:22.596854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:22.597105 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:22.597307 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:22.597377 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 00:53:22.597528 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":75,"threads_started":1}
I20260806 00:53:22.598677 9292 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:22.599376 9292 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:22.606178 9292 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec: Generated new TSK 0
I20260806 00:53:22.606421 9292 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:53:22.638959 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41325
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:32951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:22.730845 9314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:22.731058 9314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:22.731082 9314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:22.732174 9314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:22.732213 9314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:22.732239 9314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:22.733779 9314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:32951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:22.733974 9314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:22.734187 9314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:22.739742 9321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:22.739816 9324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:22.739756 9320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:22.739981 9314 server_base.cc:1034] running on GCE node
I20260806 00:53:22.740207 9314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:22.740411 9314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:22.741555 9314 hybrid_clock.cc:648] HybridClock initialized: now 1785977602741541 us; error 30 us; skew 500 ppm
Aug 06 00:53:22 dist-test-slave-44d2 krb5kdc[9169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977602, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:22.744211 9314 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:53:22.744648 9314 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:22.744701 9314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:22.744846 9314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:22.745987 9314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "25a3981647c345689f7b70e060ff31f9"
format_stamp: "Formatted at 2026-08-06 00:53:22 on dist-test-slave-44d2"
server_key: "13521534e072e219fe7a8e000fb9fffe"
server_key_iv: "5a5f7e9a8378ca68478ab8009e6b3aaa"
server_key_version: "encryptionkey@0"
I20260806 00:53:22.746358 9314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "25a3981647c345689f7b70e060ff31f9"
format_stamp: "Formatted at 2026-08-06 00:53:22 on dist-test-slave-44d2"
server_key: "13521534e072e219fe7a8e000fb9fffe"
server_key_iv: "5a5f7e9a8378ca68478ab8009e6b3aaa"
server_key_version: "encryptionkey@0"
I20260806 00:53:22.747792 9314 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:22.748639 9330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:22.748888 9314 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:22.748965 9314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "25a3981647c345689f7b70e060ff31f9"
format_stamp: "Formatted at 2026-08-06 00:53:22 on dist-test-slave-44d2"
server_key: "13521534e072e219fe7a8e000fb9fffe"
server_key_iv: "5a5f7e9a8378ca68478ab8009e6b3aaa"
server_key_version: "encryptionkey@0"
I20260806 00:53:22.749084 9314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:22.778376 9314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:22.781298 9314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:22.781489 9314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:22.781810 9314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:22.782217 9314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:22.782280 9314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:22.782331 9314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:22.782366 9314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:22.789322 9314 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:32879
I20260806 00:53:22.789364 9479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:32879 every 8 connection(s)
I20260806 00:53:22.789659 9314 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:53:22.795311 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 9314
I20260806 00:53:22.795485 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:22.795719 3466 external_mini_cluster.cc:1428] Setting key 39783f1eca58c833d450a42a2593d5d4
Aug 06 00:53:22 dist-test-slave-44d2 krb5kdc[9169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977602, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:22.799880 9310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:22.790430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:57853 (local address 127.3.98.190:41325)
0806 00:53:22.790518 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:22.790521 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:22.790704 (+ 183us) server_negotiation.cc:407] Connection header received
0806 00:53:22.791292 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:22.791294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:22.791320 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:22.791379 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:22.792364 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:22.792980 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:22.794042 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:22.794277 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:22.794367 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:22.796932 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:22.796934 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:22.796934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:22.796944 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:22.798427 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:22.798878 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:22.798879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:22.798879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:22.798949 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:22.799209 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:22.799210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:22.799210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:22.799333 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:22.799407 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:22.799700 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 00:53:22.799789 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 00:53:22.800096 9484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:22.790383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41325 (local address 127.3.98.129:57853)
0806 00:53:22.790556 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:22.790612 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:22.791175 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:22.791449 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:22.791454 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:22.791719 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:22.792250 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:22.792255 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:22.793093 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:22.793095 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:22.793915 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:22.793917 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:22.794380 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:22.794381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:22.794515 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:22.795021 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:22.795030 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:22.796835 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:22.798559 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:22.798567 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:22.798569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:22.798799 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:22.799029 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:22.799029 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:22.799030 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:22.799143 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:22.799412 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:22.799420 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:22.799564 (+ 144us) client_negotiation.cc:769] Sending connection context
0806 00:53:22.799674 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 00:53:22.799838 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260806 00:53:22.800679 9481 heartbeater.cc:347] Connected to a master server at 127.3.98.190:41325
I20260806 00:53:22.800802 9481 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:22.800967 9481 heartbeater.cc:511] Master 127.3.98.190:41325 requested a full tablet report, sending...
I20260806 00:53:22.801630 9227 ts_manager.cc:194] Registered new tserver with Master: 25a3981647c345689f7b70e060ff31f9 (127.3.98.129:32879)
I20260806 00:53:22.802659 9227 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:57853
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:53:22.823640 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41325
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:32951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:22.907838 9487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:22.908042 9487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:22.908075 9487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:22.909312 9487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:22.909358 9487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:22.909386 9487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:22.910836 9487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:32951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:22.911027 9487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:22.911211 9487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:22.916419 9495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:22.916472 9487 server_base.cc:1034] running on GCE node
W20260806 00:53:22.916411 9493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:22.916411 9492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:22.916805 9487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:22.917047 9487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:22.918226 9487 hybrid_clock.cc:648] HybridClock initialized: now 1785977602918210 us; error 27 us; skew 500 ppm
Aug 06 00:53:22 dist-test-slave-44d2 krb5kdc[9169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977602, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:22.920768 9487 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:53:22.921185 9487 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:22.921264 9487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:22.921422 9487 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:22.922533 9487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "89b74b8645fd4df9997454950247c34f"
format_stamp: "Formatted at 2026-08-06 00:53:22 on dist-test-slave-44d2"
server_key: "9248fc6ac3d3abf32d798cdb0f39991a"
server_key_iv: "721a754bcb7c15065b08efba6ee0a20b"
server_key_version: "encryptionkey@0"
I20260806 00:53:22.922938 9487 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "89b74b8645fd4df9997454950247c34f"
format_stamp: "Formatted at 2026-08-06 00:53:22 on dist-test-slave-44d2"
server_key: "9248fc6ac3d3abf32d798cdb0f39991a"
server_key_iv: "721a754bcb7c15065b08efba6ee0a20b"
server_key_version: "encryptionkey@0"
I20260806 00:53:22.924368 9487 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:22.925284 9503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:22.925524 9487 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:22.925645 9487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "89b74b8645fd4df9997454950247c34f"
format_stamp: "Formatted at 2026-08-06 00:53:22 on dist-test-slave-44d2"
server_key: "9248fc6ac3d3abf32d798cdb0f39991a"
server_key_iv: "721a754bcb7c15065b08efba6ee0a20b"
server_key_version: "encryptionkey@0"
I20260806 00:53:22.925725 9487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:22.935025 9487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:22.937542 9487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:22.937743 9487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:22.938004 9487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:22.938333 9487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:22.938391 9487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:22.938433 9487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:22.938460 9487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:22.944519 9654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:41201 every 8 connection(s)
I20260806 00:53:22.944459 9487 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:41201
I20260806 00:53:22.944855 9487 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:22.949442 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 9487
I20260806 00:53:22.949558 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:22.949743 3466 external_mini_cluster.cc:1428] Setting key b862d640e9f981d90753a6f12513b330
Aug 06 00:53:22 dist-test-slave-44d2 krb5kdc[9169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977602, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:22.955138 9657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:22.945558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41325 (local address 127.3.98.130:60823)
0806 00:53:22.945763 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:22.945809 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:22.946325 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:22.946597 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:22.946601 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:22.946857 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:22.947351 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:22.947355 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:22.948123 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:22.948124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:22.948999 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:22.949001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:22.949443 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:22.949444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:22.949701 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:22.950242 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:22.950252 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:22.951759 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:22.953780 (+ 2021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:22.953787 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:22.953789 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:22.954023 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:22.954243 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:22.954243 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:22.954244 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:22.954347 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:22.954643 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:22.954647 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:22.954761 (+ 114us) client_negotiation.cc:769] Sending connection context
0806 00:53:22.954844 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 00:53:22.954967 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":90,"threads_started":1}
I20260806 00:53:22.955150 9310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:22.945641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:60823 (local address 127.3.98.190:41325)
0806 00:53:22.945709 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:22.945711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:22.945892 (+ 181us) server_negotiation.cc:407] Connection header received
0806 00:53:22.946445 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:22.946447 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:22.946461 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:22.946523 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:22.947455 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:22.948004 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:22.949091 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:22.949350 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:22.949432 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:22.951840 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:22.951841 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:22.951842 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:22.951849 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:22.953682 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:22.954103 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:22.954105 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:22.954105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:22.954171 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:22.954414 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:22.954415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:22.954415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:22.954575 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:22.954647 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:22.954895 (+ 248us) server_negotiation.cc:299] Negotiation successful
0806 00:53:22.955004 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:53:22.955724 9655 heartbeater.cc:347] Connected to a master server at 127.3.98.190:41325
I20260806 00:53:22.955819 9655 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:22.955935 9655 heartbeater.cc:511] Master 127.3.98.190:41325 requested a full tablet report, sending...
I20260806 00:53:22.956315 9227 ts_manager.cc:194] Registered new tserver with Master: 89b74b8645fd4df9997454950247c34f (127.3.98.130:41201)
I20260806 00:53:22.956893 9227 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:60823
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:53:22.979686 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41325
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:32951
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:23.065436 9660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:23.065706 9660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:23.065747 9660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:23.066911 9660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:23.066987 9660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:23.067031 9660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:23.068601 9660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:32951
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:23.068883 9660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:23.069128 9660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:23.074236 9671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:23.074198 9669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:23.074198 9667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:23.074519 9660 server_base.cc:1034] running on GCE node
I20260806 00:53:23.074770 9660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:23.075017 9660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:23.076157 9660 hybrid_clock.cc:648] HybridClock initialized: now 1785977603076135 us; error 39 us; skew 500 ppm
Aug 06 00:53:23 dist-test-slave-44d2 krb5kdc[9169](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977603, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:23.078860 9660 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:53:23.079257 9660 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:23.079334 9660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:23.079500 9660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:23.080659 9660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "e954a2136d7f4b8cad8344454b99c1ca"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "d09626e9b023767abc776d0266d6ff67"
server_key_iv: "03f621d02364f9e0b4d92e62761db7c9"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.081040 9660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "e954a2136d7f4b8cad8344454b99c1ca"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "d09626e9b023767abc776d0266d6ff67"
server_key_iv: "03f621d02364f9e0b4d92e62761db7c9"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.082383 9660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 00:53:23.083189 9678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:23.083364 9660 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:23.083499 9660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "e954a2136d7f4b8cad8344454b99c1ca"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "d09626e9b023767abc776d0266d6ff67"
server_key_iv: "03f621d02364f9e0b4d92e62761db7c9"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.083580 9660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:23.101804 9660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:23.103677 9660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:23.103852 9660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:23.104096 9660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:23.104418 9660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:23.104476 9660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:23.104540 9660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:23.104568 9660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:23.111742 9660 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:34271
I20260806 00:53:23.111797 9821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:34271 every 8 connection(s)
I20260806 00:53:23.112104 9660 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:23.115167 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 9660
I20260806 00:53:23.115267 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:23.115448 3466 external_mini_cluster.cc:1428] Setting key fabc0cc39a095c50965d47284cfcd54d
Aug 06 00:53:23 dist-test-slave-44d2 krb5kdc[9169](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977603, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:23.121925 9310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.112879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:59067 (local address 127.3.98.190:41325)
0806 00:53:23.112925 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.112927 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.113142 (+ 215us) server_negotiation.cc:407] Connection header received
0806 00:53:23.113678 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.113679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.113694 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.113746 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:23.114709 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.115386 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.116828 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.117016 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.117079 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.119172 (+ 2093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:23.119173 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:23.119173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:23.119180 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:23.120724 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:23.121094 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:23.121095 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:23.121096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:23.121149 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:23.121361 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:23.121361 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:23.121361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:23.121463 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:23.121514 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.121789 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.121859 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:53:23.122138 9824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.112860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41325 (local address 127.3.98.131:59067)
0806 00:53:23.113012 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:23.113054 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:23.113559 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:23.113816 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:23.113820 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:23.114093 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:23.114604 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:23.114608 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.115509 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.115511 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:23.116755 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:23.116758 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.117096 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.117097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:23.117197 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.117630 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:23.117639 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:23.119077 (+ 1438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:23.120792 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:23.120798 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:23.120799 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:23.121027 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:23.121208 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:23.121209 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:23.121209 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:23.121307 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:23.121535 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:23.121542 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:23.121673 (+ 131us) client_negotiation.cc:769] Sending connection context
0806 00:53:23.121761 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 00:53:23.121885 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":73,"threads_started":1}
I20260806 00:53:23.122694 9822 heartbeater.cc:347] Connected to a master server at 127.3.98.190:41325
I20260806 00:53:23.122797 9822 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:23.122931 9822 heartbeater.cc:511] Master 127.3.98.190:41325 requested a full tablet report, sending...
I20260806 00:53:23.123337 9227 ts_manager.cc:194] Registered new tserver with Master: e954a2136d7f4b8cad8344454b99c1ca (127.3.98.131:34271)
I20260806 00:53:23.123732 9227 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:59067
I20260806 00:53:23.127070 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:53:23.134948 9310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.128425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56844 (local address 127.3.98.190:41325)
0806 00:53:23.128474 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.128476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.128623 (+ 147us) server_negotiation.cc:407] Connection header received
0806 00:53:23.128700 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.128701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.128713 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.128785 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:23.129353 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.129901 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.130686 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.130888 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.130965 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.132214 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:23.132216 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:23.132216 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:23.132224 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:23.133730 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:23.134117 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:23.134118 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:23.134119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:23.134178 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:23.134381 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:23.134382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:23.134382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:23.134539 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:23.134649 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.134765 (+ 116us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.134846 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 00:53:23.136940 9227 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56844:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:23.138598 9227 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:23.145727 9845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.141317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38858 (local address 127.3.98.130:41201)
0806 00:53:23.141497 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.141502 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.141831 (+ 329us) server_negotiation.cc:407] Connection header received
0806 00:53:23.141935 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.141938 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.141954 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.142073 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:23.142333 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.143491 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.144822 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.145300 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.145402 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.145523 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.145602 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.145640 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":99,"threads_started":1}
I20260806 00:53:23.145717 9844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.141205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:41201 (local address 127.0.0.1:38858)
0806 00:53:23.141725 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:23.141774 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:23.141838 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:23.142078 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:23.142083 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:23.142085 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:23.142165 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:23.142167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.143606 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.143607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:23.144736 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:23.144738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.145404 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.145405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:23.145496 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.145510 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 00:53:23.145588 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 00:53:23.145644 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"mutex_wait_us":47,"thread_start_us":73,"threads_started":1}
I20260806 00:53:23.145845 9842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.141222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:32879 (local address 127.0.0.1:34214)
0806 00:53:23.142095 (+ 873us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:23.142103 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:23.142144 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:23.142364 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:23.142365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:23.142367 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:23.142411 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:23.142413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.143294 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.143295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:23.144583 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:23.144586 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.145643 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.145644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:23.145700 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.145703 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:23.145748 (+ 45us) client_negotiation.cc:240] Negotiation successful
0806 00:53:23.145780 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":864,"mutex_wait_us":3,"thread_start_us":111,"threads_started":1}
I20260806 00:53:23.145853 9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.141222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:34271 (local address 127.0.0.1:47912)
0806 00:53:23.141960 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:23.141969 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:23.142020 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:23.142340 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:23.142342 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:23.142344 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:23.142386 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:23.142388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.143633 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.143634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:23.144712 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:23.144715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.145582 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.145583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:23.145651 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.145655 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:23.145685 (+ 30us) client_negotiation.cc:240] Negotiation successful
0806 00:53:23.145740 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":116,"threads_started":1}
I20260806 00:53:23.146091 9847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.141548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34214 (local address 127.3.98.129:32879)
0806 00:53:23.141730 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.141734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.142200 (+ 466us) server_negotiation.cc:407] Connection header received
0806 00:53:23.142248 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.142250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.142266 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.142365 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:23.142484 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.143191 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.144680 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.145494 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.145558 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.145614 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.145962 (+ 348us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.146000 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":82,"threads_started":1}
I20260806 00:53:23.146174 9846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.141480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47912 (local address 127.3.98.131:34271)
0806 00:53:23.141693 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.141697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.142113 (+ 416us) server_negotiation.cc:407] Connection header received
0806 00:53:23.142159 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.142161 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.142177 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.142251 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:23.142466 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.143503 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.144805 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.145462 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.145964 (+ 502us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.146025 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.146049 (+ 24us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.146087 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":109,"threads_started":1}
I20260806 00:53:23.146869 9738 tablet_service.cc:1467] Processing CreateTablet for tablet a1237bfe002d4f8fa552c322343c1566 (DEFAULT_TABLE table=test-table [id=7dbe4b7d46db4f5bba666a3c37dbc4b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:23.146991 9391 tablet_service.cc:1467] Processing CreateTablet for tablet a1237bfe002d4f8fa552c322343c1566 (DEFAULT_TABLE table=test-table [id=7dbe4b7d46db4f5bba666a3c37dbc4b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:23.147054 9569 tablet_service.cc:1467] Processing CreateTablet for tablet a1237bfe002d4f8fa552c322343c1566 (DEFAULT_TABLE table=test-table [id=7dbe4b7d46db4f5bba666a3c37dbc4b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:23.147281 9738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1237bfe002d4f8fa552c322343c1566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:23.147293 9391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1237bfe002d4f8fa552c322343c1566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:23.147437 9569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1237bfe002d4f8fa552c322343c1566. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:23.150157 9848 tablet_bootstrap.cc:492] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f: Bootstrap starting.
I20260806 00:53:23.150836 9849 tablet_bootstrap.cc:492] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9: Bootstrap starting.
I20260806 00:53:23.151041 9848 tablet_bootstrap.cc:654] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:23.151124 9850 tablet_bootstrap.cc:492] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca: Bootstrap starting.
I20260806 00:53:23.151849 9848 log.cc:824] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:23.151885 9850 tablet_bootstrap.cc:654] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:23.152534 9850 log.cc:824] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:23.152848 9848 tablet_bootstrap.cc:492] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f: No bootstrap required, opened a new log
I20260806 00:53:23.152927 9848 ts_tablet_manager.cc:1397] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 00:53:23.153157 9849 tablet_bootstrap.cc:654] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:23.153477 9850 tablet_bootstrap.cc:492] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca: No bootstrap required, opened a new log
I20260806 00:53:23.153549 9850 ts_tablet_manager.cc:1397] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 00:53:23.153719 9849 log.cc:824] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:23.154402 9849 tablet_bootstrap.cc:492] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9: No bootstrap required, opened a new log
I20260806 00:53:23.154481 9849 ts_tablet_manager.cc:1397] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 00:53:23.155031 9848 raft_consensus.cc:348] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b74b8645fd4df9997454950247c34f" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 41201 } } peers { permanent_uuid: "e954a2136d7f4b8cad8344454b99c1ca" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 34271 } } peers { permanent_uuid: "25a3981647c345689f7b70e060ff31f9" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 32879 } }
I20260806 00:53:23.155210 9848 raft_consensus.cc:374] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:23.155246 9848 raft_consensus.cc:729] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89b74b8645fd4df9997454950247c34f, State: Initialized, Role: FOLLOWER
I20260806 00:53:23.155388 9848 consensus_queue.cc:260] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b74b8645fd4df9997454950247c34f" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 41201 } } peers { permanent_uuid: "e954a2136d7f4b8cad8344454b99c1ca" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 34271 } } peers { permanent_uuid: "25a3981647c345689f7b70e060ff31f9" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 32879 } }
I20260806 00:53:23.155500 9850 raft_consensus.cc:348] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b74b8645fd4df9997454950247c34f" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 41201 } } peers { permanent_uuid: "e954a2136d7f4b8cad8344454b99c1ca" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 34271 } } peers { permanent_uuid: "25a3981647c345689f7b70e060ff31f9" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 32879 } }
I20260806 00:53:23.155663 9850 raft_consensus.cc:374] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:23.155689 9848 ts_tablet_manager.cc:1428] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:53:23.155705 9850 raft_consensus.cc:729] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e954a2136d7f4b8cad8344454b99c1ca, State: Initialized, Role: FOLLOWER
I20260806 00:53:23.155807 9655 heartbeater.cc:503] Master 127.3.98.190:41325 was elected leader, sending a full tablet report...
I20260806 00:53:23.155827 9850 consensus_queue.cc:260] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b74b8645fd4df9997454950247c34f" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 41201 } } peers { permanent_uuid: "e954a2136d7f4b8cad8344454b99c1ca" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 34271 } } peers { permanent_uuid: "25a3981647c345689f7b70e060ff31f9" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 32879 } }
I20260806 00:53:23.156113 9850 ts_tablet_manager.cc:1428] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:53:23.156140 9822 heartbeater.cc:503] Master 127.3.98.190:41325 was elected leader, sending a full tablet report...
I20260806 00:53:23.157141 9849 raft_consensus.cc:348] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b74b8645fd4df9997454950247c34f" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 41201 } } peers { permanent_uuid: "e954a2136d7f4b8cad8344454b99c1ca" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 34271 } } peers { permanent_uuid: "25a3981647c345689f7b70e060ff31f9" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 32879 } }
I20260806 00:53:23.157313 9849 raft_consensus.cc:374] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:23.157358 9849 raft_consensus.cc:729] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25a3981647c345689f7b70e060ff31f9, State: Initialized, Role: FOLLOWER
I20260806 00:53:23.157465 9849 consensus_queue.cc:260] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b74b8645fd4df9997454950247c34f" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 41201 } } peers { permanent_uuid: "e954a2136d7f4b8cad8344454b99c1ca" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 34271 } } peers { permanent_uuid: "25a3981647c345689f7b70e060ff31f9" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 32879 } }
I20260806 00:53:23.157714 9849 ts_tablet_manager.cc:1428] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:53:23.157759 9481 heartbeater.cc:503] Master 127.3.98.190:41325 was elected leader, sending a full tablet report...
W20260806 00:53:23.195361 9656 tablet.cc:2369] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:53:23.249991 9856 raft_consensus.cc:482] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:23.250133 9856 raft_consensus.cc:504] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b74b8645fd4df9997454950247c34f" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 41201 } } peers { permanent_uuid: "e954a2136d7f4b8cad8344454b99c1ca" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 34271 } } peers { permanent_uuid: "25a3981647c345689f7b70e060ff31f9" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 32879 } }
I20260806 00:53:23.250669 9856 leader_election.cc:288] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89b74b8645fd4df9997454950247c34f (127.3.98.130:41201), e954a2136d7f4b8cad8344454b99c1ca (127.3.98.131:34271)
I20260806 00:53:23.255124 9845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.250911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:56987 (local address 127.3.98.130:41201)
0806 00:53:23.250968 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.250971 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.251021 (+ 50us) server_negotiation.cc:407] Connection header received
0806 00:53:23.251107 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.251109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.251125 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.251191 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:23.251458 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.252264 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.254036 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.254628 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.254707 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.254717 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.255010 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.255054 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 00:53:23.255136 9846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.250949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:37569 (local address 127.3.98.131:34271)
0806 00:53:23.251016 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.251018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.251176 (+ 158us) server_negotiation.cc:407] Connection header received
0806 00:53:23.251252 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.251254 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.251269 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.251304 (+ 35us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:23.251535 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.252284 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.254057 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.254625 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.254707 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.254717 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.255019 (+ 302us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.255076 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 00:53:23.255132 9484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.250809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:41201 (local address 127.3.98.129:56987)
0806 00:53:23.250951 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:23.250965 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:23.251032 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:23.251251 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:23.251252 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:23.251254 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:23.251368 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:23.251371 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.252402 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.252403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:23.253904 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:23.253908 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.254754 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.254755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:23.254894 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.254899 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:53:23.254978 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 00:53:23.255034 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":79}
I20260806 00:53:23.255141 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.250846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:34271 (local address 127.3.98.129:37569)
0806 00:53:23.251079 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:23.251093 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:23.251168 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:23.251380 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:23.251381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:23.251383 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:23.251454 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:23.251455 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.252377 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.252379 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:23.253963 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:23.253965 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.254754 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.254755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:23.254936 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.254940 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:23.255003 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 00:53:23.255035 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":211,"thread_start_us":62,"threads_started":1}
I20260806 00:53:23.255610 9763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1237bfe002d4f8fa552c322343c1566" candidate_uuid: "25a3981647c345689f7b70e060ff31f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e954a2136d7f4b8cad8344454b99c1ca" is_pre_election: true
I20260806 00:53:23.255833 9763 raft_consensus.cc:2454] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a3981647c345689f7b70e060ff31f9 in term 0.
I20260806 00:53:23.255769 9595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1237bfe002d4f8fa552c322343c1566" candidate_uuid: "25a3981647c345689f7b70e060ff31f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89b74b8645fd4df9997454950247c34f" is_pre_election: true
I20260806 00:53:23.255985 9595 raft_consensus.cc:2454] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25a3981647c345689f7b70e060ff31f9 in term 0.
I20260806 00:53:23.256167 9335 leader_election.cc:302] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a3981647c345689f7b70e060ff31f9, e954a2136d7f4b8cad8344454b99c1ca; no voters:
I20260806 00:53:23.256317 9856 raft_consensus.cc:2781] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:23.256412 9856 raft_consensus.cc:482] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:23.256444 9856 raft_consensus.cc:3037] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:23.257308 9856 raft_consensus.cc:504] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b74b8645fd4df9997454950247c34f" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 41201 } } peers { permanent_uuid: "e954a2136d7f4b8cad8344454b99c1ca" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 34271 } } peers { permanent_uuid: "25a3981647c345689f7b70e060ff31f9" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 32879 } }
I20260806 00:53:23.257481 9856 leader_election.cc:288] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [CANDIDATE]: Term 1 election: Requested vote from peers 89b74b8645fd4df9997454950247c34f (127.3.98.130:41201), e954a2136d7f4b8cad8344454b99c1ca (127.3.98.131:34271)
I20260806 00:53:23.257666 9763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1237bfe002d4f8fa552c322343c1566" candidate_uuid: "25a3981647c345689f7b70e060ff31f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e954a2136d7f4b8cad8344454b99c1ca"
I20260806 00:53:23.257658 9595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1237bfe002d4f8fa552c322343c1566" candidate_uuid: "25a3981647c345689f7b70e060ff31f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89b74b8645fd4df9997454950247c34f"
I20260806 00:53:23.257750 9595 raft_consensus.cc:3037] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:23.257771 9763 raft_consensus.cc:3037] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:23.258787 9763 raft_consensus.cc:2454] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a3981647c345689f7b70e060ff31f9 in term 1.
I20260806 00:53:23.258808 9595 raft_consensus.cc:2454] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25a3981647c345689f7b70e060ff31f9 in term 1.
I20260806 00:53:23.258998 9332 leader_election.cc:302] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25a3981647c345689f7b70e060ff31f9, 89b74b8645fd4df9997454950247c34f; no voters:
I20260806 00:53:23.259100 9856 raft_consensus.cc:2781] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:23.259279 9856 raft_consensus.cc:686] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [term 1 LEADER]: Becoming Leader. State: Replica: 25a3981647c345689f7b70e060ff31f9, State: Running, Role: LEADER
I20260806 00:53:23.259406 9856 consensus_queue.cc:237] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b74b8645fd4df9997454950247c34f" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 41201 } } peers { permanent_uuid: "e954a2136d7f4b8cad8344454b99c1ca" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 34271 } } peers { permanent_uuid: "25a3981647c345689f7b70e060ff31f9" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 32879 } }
I20260806 00:53:23.260414 9227 catalog_manager.cc:5495] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25a3981647c345689f7b70e060ff31f9 (127.3.98.129). New cstate: current_term: 1 leader_uuid: "25a3981647c345689f7b70e060ff31f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89b74b8645fd4df9997454950247c34f" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e954a2136d7f4b8cad8344454b99c1ca" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 34271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25a3981647c345689f7b70e060ff31f9" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 32879 } health_report { overall_health: HEALTHY } } }
W20260806 00:53:23.290369 9482 tablet.cc:2369] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:53:23.292166 9847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.289694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34226 (local address 127.3.98.129:32879)
0806 00:53:23.289765 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.289769 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.289786 (+ 17us) server_negotiation.cc:407] Connection header received
0806 00:53:23.289829 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.289830 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.289857 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.289930 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:23.290063 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.290637 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.291424 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:23.291617 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:23.291683 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:23.291835 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:23.291944 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:23.292012 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.292032 (+ 20us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.292053 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 00:53:23.294417 9763 raft_consensus.cc:1261] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca [term 1 FOLLOWER]: Refusing update from remote peer 25a3981647c345689f7b70e060ff31f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:23.294456 9595 raft_consensus.cc:1261] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f [term 1 FOLLOWER]: Refusing update from remote peer 25a3981647c345689f7b70e060ff31f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:23.294839 9856 consensus_queue.cc:1035] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e954a2136d7f4b8cad8344454b99c1ca" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 34271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:23.295012 9862 consensus_queue.cc:1035] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89b74b8645fd4df9997454950247c34f" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:23.298491 9868 mvcc.cc:205] Tried to move back new op lower bound from 7315364263090225152 to 7315364262951211008. Current Snapshot: MvccSnapshot[applied={T|T < 7315364263090225152}]
I20260806 00:53:23.299368 9867 mvcc.cc:205] Tried to move back new op lower bound from 7315364263090225152 to 7315364262951211008. Current Snapshot: MvccSnapshot[applied={T|T < 7315364263090225152 or (T in {7315364263090225152})}]
I20260806 00:53:23.299490 9865 mvcc.cc:205] Tried to move back new op lower bound from 7315364263090225152 to 7315364262951211008. Current Snapshot: MvccSnapshot[applied={T|T < 7315364263090225152 or (T in {7315364263090225152})}]
I20260806 00:53:23.300858 9227 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:23.300971 9227 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:23.301770 9227 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7d961107207441bb8a97e64f8bc38cec: Sending DeleteTablet for 3 replicas of tablet a1237bfe002d4f8fa552c322343c1566
I20260806 00:53:23.302125 9391 tablet_service.cc:1514] Processing DeleteTablet for tablet a1237bfe002d4f8fa552c322343c1566 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:23 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:34214
I20260806 00:53:23.302187 9738 tablet_service.cc:1514] Processing DeleteTablet for tablet a1237bfe002d4f8fa552c322343c1566 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:23 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:47912
I20260806 00:53:23.302347 9569 tablet_service.cc:1514] Processing DeleteTablet for tablet a1237bfe002d4f8fa552c322343c1566 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:23 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:38858
I20260806 00:53:23.302515 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 9314
I20260806 00:53:23.302570 9876 tablet_replica.cc:330] T a1237bfe002d4f8fa552c322343c1566 P 25a3981647c345689f7b70e060ff31f9: stopping tablet replica
I20260806 00:53:23.315485 9878 tablet_replica.cc:330] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f: stopping tablet replica
I20260806 00:53:23.315659 9878 raft_consensus.cc:2229] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:23.315802 9878 raft_consensus.cc:2258] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:23.315853 9877 tablet_replica.cc:330] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca: stopping tablet replica
I20260806 00:53:23.315997 9877 raft_consensus.cc:2229] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:23.316124 9877 raft_consensus.cc:2258] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:23.316380 9878 ts_tablet_manager.cc:1905] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:23.316680 9877 ts_tablet_manager.cc:1905] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:23.318198 9878 ts_tablet_manager.cc:1918] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:23.318212 9877 ts_tablet_manager.cc:1918] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:23.318279 9878 log.cc:1196] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/a1237bfe002d4f8fa552c322343c1566
I20260806 00:53:23.318303 9877 log.cc:1196] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/a1237bfe002d4f8fa552c322343c1566
I20260806 00:53:23.318594 9878 ts_tablet_manager.cc:1939] T a1237bfe002d4f8fa552c322343c1566 P 89b74b8645fd4df9997454950247c34f: Deleting consensus metadata
I20260806 00:53:23.318665 9877 ts_tablet_manager.cc:1939] T a1237bfe002d4f8fa552c322343c1566 P e954a2136d7f4b8cad8344454b99c1ca: Deleting consensus metadata
I20260806 00:53:23.319108 9210 catalog_manager.cc:4841] TS 89b74b8645fd4df9997454950247c34f (127.3.98.130:41201): tablet a1237bfe002d4f8fa552c322343c1566 (table test-table [id=7dbe4b7d46db4f5bba666a3c37dbc4b5]) successfully deleted
I20260806 00:53:23.319114 9213 catalog_manager.cc:4841] TS e954a2136d7f4b8cad8344454b99c1ca (127.3.98.131:34271): tablet a1237bfe002d4f8fa552c322343c1566 (table test-table [id=7dbe4b7d46db4f5bba666a3c37dbc4b5]) successfully deleted
W20260806 00:53:23.320922 9212 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:32879 (error 108)
I20260806 00:53:23.321184 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 9487
I20260806 00:53:23.321915 9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.321348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:32879 (local address 127.0.0.1:34230)
0806 00:53:23.321827 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:23.321870 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:32879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454}
W20260806 00:53:23.326421 9212 catalog_manager.cc:4584] TS 25a3981647c345689f7b70e060ff31f9 (127.3.98.129:32879): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a1237bfe002d4f8fa552c322343c1566: Network error: Client connection negotiation failed: client connection to 127.3.98.129:32879: connect: Connection refused (error 111)
I20260806 00:53:23.330464 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 9660
I20260806 00:53:23.341179 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 9185
2026-08-06T00:53:23Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2349 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T00:53:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:23Z Disabled control of system clock
I20260806 00:53:23.378798 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44399
--webserver_interface=127.3.98.190
--webserver_port=0
--builtin_ntp_servers=127.3.98.148:44461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:44399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 00:53:23.469422 9885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:23.469642 9885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:23.469667 9885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:23.470765 9885 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:23.470799 9885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:23.470813 9885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:23.470825 9885 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:23.470837 9885 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:23.472127 9885 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:44399
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:23.472322 9885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:23.472568 9885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:23.477807 9892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:23.477941 9885 server_base.cc:1034] running on GCE node
W20260806 00:53:23.477829 9895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:23.477850 9893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:23.478360 9885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:23.478672 9885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:23.479848 9885 hybrid_clock.cc:648] HybridClock initialized: now 1785977603479842 us; error 38 us; skew 500 ppm
I20260806 00:53:23.486922 9885 webserver.cc:460] Webserver started at http://127.3.98.190:35197/ using document root <none> and password file <none>
I20260806 00:53:23.487244 9885 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:23.487336 9885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:23.487515 9885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:23.488965 9885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "adb156fd3d0c4062976011bdf1abb2e2"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "6ef03c537a7b38faaa24fb5c4328cd82"
server_key_iv: "86b1bb378485311251764b1be19946d0"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.489382 9885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "adb156fd3d0c4062976011bdf1abb2e2"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "6ef03c537a7b38faaa24fb5c4328cd82"
server_key_iv: "86b1bb378485311251764b1be19946d0"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.491006 9885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 00:53:23.491834 9903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:23.492024 9885 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:23.492141 9885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "adb156fd3d0c4062976011bdf1abb2e2"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "6ef03c537a7b38faaa24fb5c4328cd82"
server_key_iv: "86b1bb378485311251764b1be19946d0"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.492235 9885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:23.496065 9885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:23.496369 9885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:23.496567 9885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:23.501046 9885 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:44399
I20260806 00:53:23.501076 9974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:44399 every 8 connection(s)
I20260806 00:53:23.501457 9885 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:23.502141 9977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:23.503743 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 9885
I20260806 00:53:23.503827 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:23.504027 3466 external_mini_cluster.cc:1428] Setting key 44da1679505112d0800ed1766902e7a8
I20260806 00:53:23.505532 9977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2: Bootstrap starting.
I20260806 00:53:23.506244 9977 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:23.506616 9977 log.cc:824] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:23.506865 9980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.504628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56288 (local address 127.3.98.190:44399)
0806 00:53:23.504848 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.504857 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.504890 (+ 33us) server_negotiation.cc:407] Connection header received
0806 00:53:23.505412 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.505422 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.505474 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.505659 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:23.506395 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:23.506400 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:23.506400 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:23.506406 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:23.506464 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:23.506478 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:23.506584 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.506616 (+ 32us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.506673 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":86,"threads_started":1}
I20260806 00:53:23.507475 9977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2: No bootstrap required, opened a new log
I20260806 00:53:23.509496 9977 raft_consensus.cc:348] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adb156fd3d0c4062976011bdf1abb2e2" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44399 } }
I20260806 00:53:23.509687 9977 raft_consensus.cc:374] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:23.509713 9977 raft_consensus.cc:729] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adb156fd3d0c4062976011bdf1abb2e2, State: Initialized, Role: FOLLOWER
I20260806 00:53:23.509845 9977 consensus_queue.cc:260] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adb156fd3d0c4062976011bdf1abb2e2" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44399 } }
I20260806 00:53:23.509929 9977 raft_consensus.cc:388] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:23.509953 9977 raft_consensus.cc:482] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:23.510013 9977 raft_consensus.cc:3037] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:23.510977 9977 raft_consensus.cc:504] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adb156fd3d0c4062976011bdf1abb2e2" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44399 } }
I20260806 00:53:23.511108 9977 leader_election.cc:302] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: adb156fd3d0c4062976011bdf1abb2e2; no voters:
I20260806 00:53:23.511273 9977 leader_election.cc:288] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:23.511433 9983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:23.511549 9983 raft_consensus.cc:686] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [term 1 LEADER]: Becoming Leader. State: Replica: adb156fd3d0c4062976011bdf1abb2e2, State: Running, Role: LEADER
I20260806 00:53:23.511562 9977 sys_catalog.cc:564] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:23.511637 9983 consensus_queue.cc:237] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adb156fd3d0c4062976011bdf1abb2e2" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44399 } }
I20260806 00:53:23.512048 9984 sys_catalog.cc:455] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "adb156fd3d0c4062976011bdf1abb2e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adb156fd3d0c4062976011bdf1abb2e2" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44399 } } }
I20260806 00:53:23.512161 9984 sys_catalog.cc:458] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:23.512351 9986 sys_catalog.cc:455] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader adb156fd3d0c4062976011bdf1abb2e2. Latest consensus state: current_term: 1 leader_uuid: "adb156fd3d0c4062976011bdf1abb2e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adb156fd3d0c4062976011bdf1abb2e2" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44399 } } }
I20260806 00:53:23.512424 9986 sys_catalog.cc:458] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:23.512559 9993 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:23.513084 9993 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:23.514554 9993 catalog_manager.cc:1347] Generated new cluster ID: ee94fc4cee6142d99eaacc6a11023abe
I20260806 00:53:23.514611 9993 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:53:23.520498 9993 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:23.520661 9993 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:23.528542 9993 catalog_manager.cc:5868] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2: Generated new TSK 0
I20260806 00:53:23.528760 9993 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:53:23.535756 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44399
--builtin_ntp_servers=127.3.98.148:44461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 00:53:23.633114 10007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:23.633359 10007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:23.633399 10007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:23.634547 10007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:23.634620 10007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:23.634665 10007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:23.636041 10007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:23.636312 10007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:23.636670 10007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 00:53:23.642820 10007 server_base.cc:1034] running on GCE node
W20260806 00:53:23.642799 10014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:23.642803 10017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:23.643049 10013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:23.643297 10007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:23.643587 10007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:23.644748 10007 hybrid_clock.cc:648] HybridClock initialized: now 1785977603644729 us; error 45 us; skew 500 ppm
I20260806 00:53:23.646250 10007 webserver.cc:460] Webserver started at http://127.3.98.129:36451/ using document root <none> and password file <none>
I20260806 00:53:23.646512 10007 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:23.646559 10007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:23.646698 10007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:23.647825 10007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "67bb0af6f7e84434b02fc61b7da1ff3b"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "df032d8337cc6c592b0189950b4838c2"
server_key_iv: "2712c401f063d3a1f9d8ef4efb6c06d9"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.648270 10007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "67bb0af6f7e84434b02fc61b7da1ff3b"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "df032d8337cc6c592b0189950b4838c2"
server_key_iv: "2712c401f063d3a1f9d8ef4efb6c06d9"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.649751 10007 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:23.650580 10023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:23.650812 10007 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:23.650944 10007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "67bb0af6f7e84434b02fc61b7da1ff3b"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "df032d8337cc6c592b0189950b4838c2"
server_key_iv: "2712c401f063d3a1f9d8ef4efb6c06d9"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.651036 10007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:23.656311 10007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:23.656679 10007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:23.656862 10007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:23.657130 10007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:23.657608 10007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:23.657673 10007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:23.657716 10007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:23.657753 10007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:23.665498 10007 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:40317
I20260806 00:53:23.665547 10187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:40317 every 8 connection(s)
I20260806 00:53:23.665910 10007 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:53:23.669327 9980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.666732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:46187 (local address 127.3.98.190:44399)
0806 00:53:23.666810 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.666814 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.667100 (+ 286us) server_negotiation.cc:407] Connection header received
0806 00:53:23.667583 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.667585 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.667592 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.667669 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:23.669072 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:23.669074 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:23.669075 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:23.669080 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:23.669097 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:23.669102 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:23.669182 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.669254 (+ 72us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.669274 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 00:53:23.669543 10190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.666721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44399 (local address 127.3.98.129:46187)
0806 00:53:23.666952 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:23.666993 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:23.667479 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:23.667737 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:23.667741 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:23.667749 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:23.668913 (+ 1164us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:23.668913 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:23.668941 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:23.668972 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:23.669178 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:23.669181 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:23.669183 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:53:23.669241 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 00:53:23.669290 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":129,"threads_started":1}
I20260806 00:53:23.670109 10188 heartbeater.cc:347] Connected to a master server at 127.3.98.190:44399
I20260806 00:53:23.670203 10188 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:23.670325 10188 heartbeater.cc:511] Master 127.3.98.190:44399 requested a full tablet report, sending...
I20260806 00:53:23.670809 9926 ts_manager.cc:194] Registered new tserver with Master: 67bb0af6f7e84434b02fc61b7da1ff3b (127.3.98.129:40317)
I20260806 00:53:23.674054 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 10007
I20260806 00:53:23.674203 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:23.674420 3466 external_mini_cluster.cc:1428] Setting key f52907a91de64673012ba3bf216212e8
I20260806 00:53:23.675446 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44399
--builtin_ntp_servers=127.3.98.148:44461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 00:53:23.759805 10191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:23.760018 10191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:23.760041 10191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:23.761415 10191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:23.761468 10191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:23.761497 10191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:23.762854 10191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:23.763131 10191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:23.763456 10191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:23.768734 10197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:23.768843 10198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:23.768749 10202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:23.768805 10191 server_base.cc:1034] running on GCE node
I20260806 00:53:23.769168 10191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:23.769421 10191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:23.770583 10191 hybrid_clock.cc:648] HybridClock initialized: now 1785977603770545 us; error 40 us; skew 500 ppm
I20260806 00:53:23.771891 10191 webserver.cc:460] Webserver started at http://127.3.98.130:38527/ using document root <none> and password file <none>
I20260806 00:53:23.772146 10191 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:23.772220 10191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:23.772379 10191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:23.773518 10191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "5a7fb9959e96492ebff957f761bed77e"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "dcc0e394c83673cedb0b864505dedc71"
server_key_iv: "b68c4c355fa7b849efd5b5c4fc1bc6a0"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.773957 10191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "5a7fb9959e96492ebff957f761bed77e"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "dcc0e394c83673cedb0b864505dedc71"
server_key_iv: "b68c4c355fa7b849efd5b5c4fc1bc6a0"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.775322 10191 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:53:23.776059 10210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:23.776243 10191 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:23.776350 10191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "5a7fb9959e96492ebff957f761bed77e"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "dcc0e394c83673cedb0b864505dedc71"
server_key_iv: "b68c4c355fa7b849efd5b5c4fc1bc6a0"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.776424 10191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:23.779886 10191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:23.780149 10191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:23.780289 10191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:23.780550 10191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:23.780886 10191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:23.780942 10191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:23.780982 10191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:23.781009 10191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:23.786662 10191 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:37253
I20260806 00:53:23.786700 10355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:37253 every 8 connection(s)
I20260806 00:53:23.787071 10191 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:23.790314 9980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.787845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:39069 (local address 127.3.98.190:44399)
0806 00:53:23.787893 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.787895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.788190 (+ 295us) server_negotiation.cc:407] Connection header received
0806 00:53:23.788765 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.788766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.788773 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.788840 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:23.790044 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:23.790046 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:23.790046 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:23.790051 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:23.790067 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:23.790071 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:23.790147 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.790226 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.790242 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:53:23.790503 10358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.787820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44399 (local address 127.3.98.130:39069)
0806 00:53:23.788049 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:23.788095 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:23.788657 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:23.788912 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:23.788917 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:23.788927 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:23.789843 (+ 916us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:23.789844 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:23.789871 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:23.789899 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:23.790148 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:23.790156 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:23.790159 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:23.790227 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 00:53:23.790291 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":105,"threads_started":1}
I20260806 00:53:23.791006 10356 heartbeater.cc:347] Connected to a master server at 127.3.98.190:44399
I20260806 00:53:23.791128 10356 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:23.791282 10356 heartbeater.cc:511] Master 127.3.98.190:44399 requested a full tablet report, sending...
I20260806 00:53:23.791266 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 10191
I20260806 00:53:23.791373 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:23.791579 3466 external_mini_cluster.cc:1428] Setting key f6eac9bee21c59e4f121ac6f2ff4f65b
I20260806 00:53:23.791706 9926 ts_manager.cc:194] Registered new tserver with Master: 5a7fb9959e96492ebff957f761bed77e (127.3.98.130:37253)
I20260806 00:53:23.792587 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44399
--builtin_ntp_servers=127.3.98.148:44461
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 00:53:23.876579 10360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:23.876782 10360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:23.876804 10360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:23.877990 10360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:23.878034 10360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:23.878060 10360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:23.879879 10360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44461
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:23.880169 10360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:23.880581 10360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:23.886057 10369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:23.886080 10360 server_base.cc:1034] running on GCE node
W20260806 00:53:23.886023 10373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:23.886041 10370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:23.886482 10360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:23.886754 10360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:23.887926 10360 hybrid_clock.cc:648] HybridClock initialized: now 1785977603887891 us; error 46 us; skew 500 ppm
I20260806 00:53:23.889328 10360 webserver.cc:460] Webserver started at http://127.3.98.131:38057/ using document root <none> and password file <none>
I20260806 00:53:23.889616 10360 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:23.889699 10360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:23.889858 10360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:23.890962 10360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "298c833b79784795aba0195e14963cd1"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "113af51a9b1005bb02be239663a9d430"
server_key_iv: "0a1223b9b81b4b2dcf3f6dd528d95be5"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.891464 10360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "298c833b79784795aba0195e14963cd1"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "113af51a9b1005bb02be239663a9d430"
server_key_iv: "0a1223b9b81b4b2dcf3f6dd528d95be5"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.892999 10360 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:53:23.893783 10380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:23.893966 10360 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:23.894088 10360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "298c833b79784795aba0195e14963cd1"
format_stamp: "Formatted at 2026-08-06 00:53:23 on dist-test-slave-44d2"
server_key: "113af51a9b1005bb02be239663a9d430"
server_key_iv: "0a1223b9b81b4b2dcf3f6dd528d95be5"
server_key_version: "encryptionkey@0"
I20260806 00:53:23.894165 10360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:23.897764 10360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:23.898084 10360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:23.898233 10360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:23.898445 10360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:23.898759 10360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:23.898814 10360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:23.898854 10360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:23.898880 10360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:23.904788 10360 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:38123
I20260806 00:53:23.904840 10533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:38123 every 8 connection(s)
I20260806 00:53:23.905205 10360 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:23.908105 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 10360
I20260806 00:53:23.908221 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:23.908329 9980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.905992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:34699 (local address 127.3.98.190:44399)
0806 00:53:23.906038 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.906040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.906274 (+ 234us) server_negotiation.cc:407] Connection header received
0806 00:53:23.906759 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.906760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.906767 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.906823 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:23.908055 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:23.908055 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:23.908056 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:23.908058 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:23.908069 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:23.908073 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:23.908113 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.908238 (+ 125us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.908253 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:53:23.908406 3466 external_mini_cluster.cc:1428] Setting key 3b10df30b13a2f91289409bc4983fe1a
I20260806 00:53:23.908589 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.905975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44399 (local address 127.3.98.131:34699)
0806 00:53:23.906167 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:23.906199 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:23.906668 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:23.906877 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:23.906880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:23.906888 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:23.907869 (+ 981us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:23.907870 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:23.907929 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:23.907968 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:23.908117 (+ 149us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:23.908122 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:23.908125 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:23.908205 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 00:53:23.908275 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":109,"threads_started":1}
I20260806 00:53:23.909250 10534 heartbeater.cc:347] Connected to a master server at 127.3.98.190:44399
I20260806 00:53:23.909355 10534 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:23.909508 10534 heartbeater.cc:511] Master 127.3.98.190:44399 requested a full tablet report, sending...
I20260806 00:53:23.909864 9926 ts_manager.cc:194] Registered new tserver with Master: 298c833b79784795aba0195e14963cd1 (127.3.98.131:38123)
I20260806 00:53:23.920416 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:53:23.923138 9980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.921975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56302 (local address 127.3.98.190:44399)
0806 00:53:23.922045 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.922048 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.922173 (+ 125us) server_negotiation.cc:407] Connection header received
0806 00:53:23.922247 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.922247 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.922254 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.922312 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:23.922901 (+ 589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:23.922902 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:23.922903 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:23.922907 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:23.922923 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:23.922927 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:23.922985 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.923036 (+ 51us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.923052 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 00:53:23.924849 9926 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56302:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:23.926409 9926 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:23.930570 10547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.928780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:38123 (local address 127.0.0.1:44150)
0806 00:53:23.928928 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:23.928972 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:23.929042 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:23.929571 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:23.929572 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:23.929575 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:23.930116 (+ 541us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:23.930116 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:23.930132 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:23.930152 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:23.930384 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:23.930391 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:23.930394 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:23.930468 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 00:53:23.930483 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260806 00:53:23.930819 10551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.928990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44150 (local address 127.3.98.131:38123)
0806 00:53:23.929407 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.929412 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.929422 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:23.929451 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.929453 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.929463 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.929578 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:23.930237 (+ 659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:23.930244 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:23.930244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:23.930248 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:23.930282 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:23.930313 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:23.930390 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.930707 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.930725 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":83,"threads_started":1}
I20260806 00:53:23.931077 10553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.929088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56896 (local address 127.3.98.130:37253)
0806 00:53:23.929294 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.929300 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.929356 (+ 56us) server_negotiation.cc:407] Connection header received
0806 00:53:23.929461 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.929466 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.929475 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.929658 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:23.930547 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:23.930555 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:23.930556 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:23.930586 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:23.930725 (+ 139us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:23.930758 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:23.930826 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.930957 (+ 131us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.930976 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":93,"threads_started":1}
I20260806 00:53:23.931164 10548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.928802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:37253 (local address 127.0.0.1:56896)
0806 00:53:23.929288 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:23.929300 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:23.929362 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:23.929977 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:23.929978 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:23.929981 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:23.930415 (+ 434us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:23.930416 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:23.930426 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:23.930442 (+ 16us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:23.930822 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:23.930823 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:23.930824 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 00:53:23.931084 (+ 260us) client_negotiation.cc:240] Negotiation successful
0806 00:53:23.931101 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":121,"threads_started":1}
I20260806 00:53:23.931442 10550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.928788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:40317 (local address 127.0.0.1:43878)
0806 00:53:23.929111 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:23.929121 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:23.929158 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:23.929555 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:23.929562 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:23.929569 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:23.930667 (+ 1098us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:23.930668 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:23.930676 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:23.930691 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:23.931309 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:23.931310 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:23.931311 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 00:53:23.931348 (+ 37us) client_negotiation.cc:240] Negotiation successful
0806 00:53:23.931362 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":148,"threads_started":1}
I20260806 00:53:23.931571 10451 tablet_service.cc:1467] Processing CreateTablet for tablet 25ee9aa0b0fb44ad8adbd12fade43ac8 (DEFAULT_TABLE table=test-table [id=f86c9c31bca74c97b434368e4e3fe868]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:23.931789 10555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:23.929177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43878 (local address 127.3.98.129:40317)
0806 00:53:23.929369 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:23.929372 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:23.929383 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:53:23.929413 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:23.929415 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:23.929427 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:23.930462 (+ 1035us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:23.931131 (+ 669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:23.931135 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:23.931135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:23.931139 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:23.931174 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:23.931191 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:23.931647 (+ 456us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:23.931674 (+ 27us) server_negotiation.cc:299] Negotiation successful
0806 00:53:23.931693 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":94,"threads_started":1}
I20260806 00:53:23.932016 10451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25ee9aa0b0fb44ad8adbd12fade43ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:23.932082 10268 tablet_service.cc:1467] Processing CreateTablet for tablet 25ee9aa0b0fb44ad8adbd12fade43ac8 (DEFAULT_TABLE table=test-table [id=f86c9c31bca74c97b434368e4e3fe868]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:23.932509 10268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25ee9aa0b0fb44ad8adbd12fade43ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:23.932529 10088 tablet_service.cc:1467] Processing CreateTablet for tablet 25ee9aa0b0fb44ad8adbd12fade43ac8 (DEFAULT_TABLE table=test-table [id=f86c9c31bca74c97b434368e4e3fe868]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:23.933092 10088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25ee9aa0b0fb44ad8adbd12fade43ac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:23.934985 10556 tablet_bootstrap.cc:492] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1: Bootstrap starting.
I20260806 00:53:23.935773 10556 tablet_bootstrap.cc:654] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:23.936163 10557 tablet_bootstrap.cc:492] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e: Bootstrap starting.
I20260806 00:53:23.936158 10556 log.cc:824] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:23.936416 10558 tablet_bootstrap.cc:492] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b: Bootstrap starting.
I20260806 00:53:23.937005 10557 tablet_bootstrap.cc:654] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:23.937040 10558 tablet_bootstrap.cc:654] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:23.937041 10556 tablet_bootstrap.cc:492] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1: No bootstrap required, opened a new log
I20260806 00:53:23.937103 10556 ts_tablet_manager.cc:1397] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:53:23.937325 10558 log.cc:824] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:23.937435 10557 log.cc:824] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:23.938062 10558 tablet_bootstrap.cc:492] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b: No bootstrap required, opened a new log
I20260806 00:53:23.938141 10558 ts_tablet_manager.cc:1397] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 00:53:23.939296 10556 raft_consensus.cc:348] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298c833b79784795aba0195e14963cd1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38123 } } peers { permanent_uuid: "67bb0af6f7e84434b02fc61b7da1ff3b" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40317 } } peers { permanent_uuid: "5a7fb9959e96492ebff957f761bed77e" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37253 } }
I20260806 00:53:23.939428 10556 raft_consensus.cc:374] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:23.939450 10556 raft_consensus.cc:729] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 298c833b79784795aba0195e14963cd1, State: Initialized, Role: FOLLOWER
I20260806 00:53:23.939581 10556 consensus_queue.cc:260] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298c833b79784795aba0195e14963cd1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38123 } } peers { permanent_uuid: "67bb0af6f7e84434b02fc61b7da1ff3b" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40317 } } peers { permanent_uuid: "5a7fb9959e96492ebff957f761bed77e" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37253 } }
I20260806 00:53:23.939878 10556 ts_tablet_manager.cc:1428] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:53:23.939906 10534 heartbeater.cc:503] Master 127.3.98.190:44399 was elected leader, sending a full tablet report...
I20260806 00:53:23.940099 10558 raft_consensus.cc:348] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298c833b79784795aba0195e14963cd1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38123 } } peers { permanent_uuid: "67bb0af6f7e84434b02fc61b7da1ff3b" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40317 } } peers { permanent_uuid: "5a7fb9959e96492ebff957f761bed77e" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37253 } }
I20260806 00:53:23.940271 10558 raft_consensus.cc:374] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:23.940322 10558 raft_consensus.cc:729] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67bb0af6f7e84434b02fc61b7da1ff3b, State: Initialized, Role: FOLLOWER
I20260806 00:53:23.940446 10558 consensus_queue.cc:260] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298c833b79784795aba0195e14963cd1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38123 } } peers { permanent_uuid: "67bb0af6f7e84434b02fc61b7da1ff3b" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40317 } } peers { permanent_uuid: "5a7fb9959e96492ebff957f761bed77e" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37253 } }
I20260806 00:53:23.940632 10557 tablet_bootstrap.cc:492] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e: No bootstrap required, opened a new log
I20260806 00:53:23.940699 10557 ts_tablet_manager.cc:1397] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 00:53:23.940721 10558 ts_tablet_manager.cc:1428] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260806 00:53:23.940886 10188 heartbeater.cc:503] Master 127.3.98.190:44399 was elected leader, sending a full tablet report...
I20260806 00:53:23.942843 10557 raft_consensus.cc:348] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298c833b79784795aba0195e14963cd1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38123 } } peers { permanent_uuid: "67bb0af6f7e84434b02fc61b7da1ff3b" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40317 } } peers { permanent_uuid: "5a7fb9959e96492ebff957f761bed77e" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37253 } }
I20260806 00:53:23.942986 10557 raft_consensus.cc:374] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:23.943034 10557 raft_consensus.cc:729] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7fb9959e96492ebff957f761bed77e, State: Initialized, Role: FOLLOWER
I20260806 00:53:23.943176 10557 consensus_queue.cc:260] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298c833b79784795aba0195e14963cd1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38123 } } peers { permanent_uuid: "67bb0af6f7e84434b02fc61b7da1ff3b" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40317 } } peers { permanent_uuid: "5a7fb9959e96492ebff957f761bed77e" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37253 } }
I20260806 00:53:23.943463 10557 ts_tablet_manager.cc:1428] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:53:23.943552 10356 heartbeater.cc:503] Master 127.3.98.190:44399 was elected leader, sending a full tablet report...
W20260806 00:53:24.037716 10357 tablet.cc:2369] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:53:24.069865 10564 raft_consensus.cc:482] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:24.070024 10564 raft_consensus.cc:504] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298c833b79784795aba0195e14963cd1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38123 } } peers { permanent_uuid: "67bb0af6f7e84434b02fc61b7da1ff3b" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40317 } } peers { permanent_uuid: "5a7fb9959e96492ebff957f761bed77e" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37253 } }
I20260806 00:53:24.070400 10564 leader_election.cc:288] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 298c833b79784795aba0195e14963cd1 (127.3.98.131:38123), 67bb0af6f7e84434b02fc61b7da1ff3b (127.3.98.129:40317)
I20260806 00:53:24.072163 10358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:24.070661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:38123 (local address 127.3.98.130:56287)
0806 00:53:24.070737 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:24.070753 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:24.070820 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:24.071094 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:24.071095 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:24.071098 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:24.071664 (+ 566us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:24.071665 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:24.071675 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:24.071691 (+ 16us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:24.071992 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:24.071994 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:24.071994 (+ 0us) client_negotiation.cc:769] Sending connection context
0806 00:53:24.072063 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 00:53:24.072079 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 00:53:24.072229 10551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:24.070754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:56287 (local address 127.3.98.131:38123)
0806 00:53:24.070924 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:24.070926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:24.070941 (+ 15us) server_negotiation.cc:407] Connection header received
0806 00:53:24.070978 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:24.070980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:24.070988 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:24.071071 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:24.071789 (+ 718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:24.071790 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:24.071790 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:24.071795 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:24.071814 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:24.071819 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:24.071974 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:24.072125 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 00:53:24.072142 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 00:53:24.072305 10565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:24.070661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:40317 (local address 127.3.98.130:58743)
0806 00:53:24.071013 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:24.071022 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:24.071091 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:24.071229 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:24.071230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:24.071232 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:24.071859 (+ 627us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:24.071860 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:24.071867 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:24.071880 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:24.072128 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:24.072130 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:24.072131 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 00:53:24.072202 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 00:53:24.072215 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":155,"thread_start_us":124,"threads_started":1}
I20260806 00:53:24.072300 10555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:24.070769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:58743 (local address 127.3.98.129:40317)
0806 00:53:24.070817 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:24.070819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:24.071090 (+ 271us) server_negotiation.cc:407] Connection header received
0806 00:53:24.071157 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:24.071158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:24.071164 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:24.071224 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:24.072002 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:24.072004 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:24.072004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:24.072010 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:24.072031 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:24.072037 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:24.072106 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:24.072200 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 00:53:24.072216 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 00:53:24.072624 10479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ee9aa0b0fb44ad8adbd12fade43ac8" candidate_uuid: "5a7fb9959e96492ebff957f761bed77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298c833b79784795aba0195e14963cd1" is_pre_election: true
I20260806 00:53:24.072822 10479 raft_consensus.cc:2454] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7fb9959e96492ebff957f761bed77e in term 0.
I20260806 00:53:24.072795 10125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ee9aa0b0fb44ad8adbd12fade43ac8" candidate_uuid: "5a7fb9959e96492ebff957f761bed77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67bb0af6f7e84434b02fc61b7da1ff3b" is_pre_election: true
I20260806 00:53:24.072932 10125 raft_consensus.cc:2454] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a7fb9959e96492ebff957f761bed77e in term 0.
I20260806 00:53:24.073086 10214 leader_election.cc:302] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 298c833b79784795aba0195e14963cd1, 5a7fb9959e96492ebff957f761bed77e; no voters:
I20260806 00:53:24.073252 10564 raft_consensus.cc:2781] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:24.073304 10564 raft_consensus.cc:482] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:24.073320 10564 raft_consensus.cc:3037] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:24.074061 10564 raft_consensus.cc:504] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298c833b79784795aba0195e14963cd1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38123 } } peers { permanent_uuid: "67bb0af6f7e84434b02fc61b7da1ff3b" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40317 } } peers { permanent_uuid: "5a7fb9959e96492ebff957f761bed77e" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37253 } }
I20260806 00:53:24.074200 10564 leader_election.cc:288] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [CANDIDATE]: Term 1 election: Requested vote from peers 298c833b79784795aba0195e14963cd1 (127.3.98.131:38123), 67bb0af6f7e84434b02fc61b7da1ff3b (127.3.98.129:40317)
I20260806 00:53:24.074338 10125 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ee9aa0b0fb44ad8adbd12fade43ac8" candidate_uuid: "5a7fb9959e96492ebff957f761bed77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67bb0af6f7e84434b02fc61b7da1ff3b"
I20260806 00:53:24.074385 10479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ee9aa0b0fb44ad8adbd12fade43ac8" candidate_uuid: "5a7fb9959e96492ebff957f761bed77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "298c833b79784795aba0195e14963cd1"
I20260806 00:53:24.074416 10125 raft_consensus.cc:3037] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:24.074467 10479 raft_consensus.cc:3037] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:24.075325 10125 raft_consensus.cc:2454] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7fb9959e96492ebff957f761bed77e in term 1.
I20260806 00:53:24.075325 10479 raft_consensus.cc:2454] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a7fb9959e96492ebff957f761bed77e in term 1.
I20260806 00:53:24.075531 10214 leader_election.cc:302] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 298c833b79784795aba0195e14963cd1, 5a7fb9959e96492ebff957f761bed77e; no voters:
I20260806 00:53:24.075640 10564 raft_consensus.cc:2781] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:24.075798 10564 raft_consensus.cc:686] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [term 1 LEADER]: Becoming Leader. State: Replica: 5a7fb9959e96492ebff957f761bed77e, State: Running, Role: LEADER
I20260806 00:53:24.075896 10564 consensus_queue.cc:237] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298c833b79784795aba0195e14963cd1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38123 } } peers { permanent_uuid: "67bb0af6f7e84434b02fc61b7da1ff3b" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40317 } } peers { permanent_uuid: "5a7fb9959e96492ebff957f761bed77e" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37253 } }
I20260806 00:53:24.076962 9926 catalog_manager.cc:5495] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a7fb9959e96492ebff957f761bed77e (127.3.98.130). New cstate: current_term: 1 leader_uuid: "5a7fb9959e96492ebff957f761bed77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "298c833b79784795aba0195e14963cd1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67bb0af6f7e84434b02fc61b7da1ff3b" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a7fb9959e96492ebff957f761bed77e" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37253 } health_report { overall_health: HEALTHY } } }
I20260806 00:53:24.117569 10553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:24.116371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56898 (local address 127.3.98.130:37253)
0806 00:53:24.116470 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:24.116472 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:24.116505 (+ 33us) server_negotiation.cc:407] Connection header received
0806 00:53:24.116548 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:24.116549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:24.116566 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:24.116621 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:24.117277 (+ 656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:24.117279 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:24.117279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:24.117284 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:24.117305 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:24.117309 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:24.117376 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:24.117433 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 00:53:24.117466 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 00:53:24.119627 10125 raft_consensus.cc:1261] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 67bb0af6f7e84434b02fc61b7da1ff3b [term 1 FOLLOWER]: Refusing update from remote peer 5a7fb9959e96492ebff957f761bed77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:24.119626 10479 raft_consensus.cc:1261] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1 [term 1 FOLLOWER]: Refusing update from remote peer 5a7fb9959e96492ebff957f761bed77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:24.120009 10566 consensus_queue.cc:1035] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67bb0af6f7e84434b02fc61b7da1ff3b" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:24.120170 10564 consensus_queue.cc:1035] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "298c833b79784795aba0195e14963cd1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:24.122993 10569 mvcc.cc:205] Tried to move back new op lower bound from 7315364266470760448 to 7315364266295705600. Current Snapshot: MvccSnapshot[applied={T|T < 7315364266470760448}]
I20260806 00:53:24.123135 10572 mvcc.cc:205] Tried to move back new op lower bound from 7315364266470760448 to 7315364266295705600. Current Snapshot: MvccSnapshot[applied={T|T < 7315364266470760448}]
I20260806 00:53:24.123493 10570 mvcc.cc:205] Tried to move back new op lower bound from 7315364266470760448 to 7315364266295705600. Current Snapshot: MvccSnapshot[applied={T|T < 7315364266470760448}]
I20260806 00:53:24.126050 9925 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:24.126166 9925 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:24.126974 9925 catalog_manager.cc:5782] T 00000000000000000000000000000000 P adb156fd3d0c4062976011bdf1abb2e2: Sending DeleteTablet for 3 replicas of tablet 25ee9aa0b0fb44ad8adbd12fade43ac8
I20260806 00:53:24.127410 10268 tablet_service.cc:1514] Processing DeleteTablet for tablet 25ee9aa0b0fb44ad8adbd12fade43ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:24 UTC) from {username='slave'} at 127.0.0.1:56896
I20260806 00:53:24.127435 10088 tablet_service.cc:1514] Processing DeleteTablet for tablet 25ee9aa0b0fb44ad8adbd12fade43ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:24 UTC) from {username='slave'} at 127.0.0.1:43878
I20260806 00:53:24.127435 10451 tablet_service.cc:1514] Processing DeleteTablet for tablet 25ee9aa0b0fb44ad8adbd12fade43ac8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:24 UTC) from {username='slave'} at 127.0.0.1:44150
I20260806 00:53:24.127661 10584 tablet_replica.cc:330] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e: stopping tablet replica
I20260806 00:53:24.127758 10584 raft_consensus.cc:2229] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:53:24.127889 10584 raft_consensus.cc:2258] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:24.127934 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 10007
I20260806 00:53:24.132843 10586 tablet_replica.cc:330] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1: stopping tablet replica
I20260806 00:53:24.132983 10586 raft_consensus.cc:2229] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:24.133112 10586 raft_consensus.cc:2258] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:24.134117 10584 ts_tablet_manager.cc:1905] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:24.136278 10584 ts_tablet_manager.cc:1918] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:24.136338 10586 ts_tablet_manager.cc:1905] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:24.136472 10584 log.cc:1196] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/25ee9aa0b0fb44ad8adbd12fade43ac8
I20260806 00:53:24.136915 10584 ts_tablet_manager.cc:1939] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 5a7fb9959e96492ebff957f761bed77e: Deleting consensus metadata
I20260806 00:53:24.137449 9906 catalog_manager.cc:4841] TS 5a7fb9959e96492ebff957f761bed77e (127.3.98.130:37253): tablet 25ee9aa0b0fb44ad8adbd12fade43ac8 (table test-table [id=f86c9c31bca74c97b434368e4e3fe868]) successfully deleted
I20260806 00:53:24.137951 10586 ts_tablet_manager.cc:1918] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:24.138029 10586 log.cc:1196] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/25ee9aa0b0fb44ad8adbd12fade43ac8
I20260806 00:53:24.138309 10586 ts_tablet_manager.cc:1939] T 25ee9aa0b0fb44ad8adbd12fade43ac8 P 298c833b79784795aba0195e14963cd1: Deleting consensus metadata
I20260806 00:53:24.138777 9908 catalog_manager.cc:4841] TS 298c833b79784795aba0195e14963cd1 (127.3.98.131:38123): tablet 25ee9aa0b0fb44ad8adbd12fade43ac8 (table test-table [id=f86c9c31bca74c97b434368e4e3fe868]) successfully deleted
W20260806 00:53:24.140780 9905 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:40317 (error 108)
I20260806 00:53:24.141324 10550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:24.141167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:40317 (local address 127.0.0.1:43890)
0806 00:53:24.141234 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:24.141281 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:40317: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 00:53:24.141407 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 10191
W20260806 00:53:24.141515 9905 catalog_manager.cc:4584] TS 67bb0af6f7e84434b02fc61b7da1ff3b (127.3.98.129:40317): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 25ee9aa0b0fb44ad8adbd12fade43ac8: Network error: Client connection negotiation failed: client connection to 127.3.98.129:40317: connect: Connection refused (error 111)
I20260806 00:53:24.154537 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 10360
I20260806 00:53:24.163810 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 9885
2026-08-06T00:53:24Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (819 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 00:53:24.190130 3466 mini_oidc.cc:152] Starting JWKS server
I20260806 00:53:24.191295 3466 webserver.cc:460] Webserver started at https://127.0.0.1:41299/ using document root <none> and password file <none>
I20260806 00:53:24.191401 3466 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 00:53:24.191577 3466 webserver.cc:460] Webserver started at http://127.0.0.1:44867/ using document root <none> and password file <none>
2026-08-06T00:53:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:24Z Disabled control of system clock
I20260806 00:53:24.200646 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:36705
--webserver_interface=127.3.98.190
--webserver_port=0
--builtin_ntp_servers=127.3.98.148:38441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:36705
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41299/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/testchainca.cert with env {}
W20260806 00:53:24.284546 10595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:24.284832 10595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:24.284873 10595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:24.286093 10595 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:24.286175 10595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:24.286196 10595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:24.286218 10595 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:24.286247 10595 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 00:53:24.286270 10595 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 00:53:24.286300 10595 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41299/jwks.json
I20260806 00:53:24.287941 10595 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:38441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:36705
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:36705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41299/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:24.288250 10595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:24.288499 10595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:24.293537 10606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:24.293550 10603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:24.293529 10602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:24.293813 10595 server_base.cc:1034] running on GCE node
I20260806 00:53:24.294114 10595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:24.294406 10595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:24.295593 10595 hybrid_clock.cc:648] HybridClock initialized: now 1785977604295582 us; error 37 us; skew 500 ppm
I20260806 00:53:24.296940 10595 webserver.cc:460] Webserver started at http://127.3.98.190:41905/ using document root <none> and password file <none>
I20260806 00:53:24.297247 10595 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:24.297320 10595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:24.297475 10595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:24.298555 10595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "f8b501d631744959925894485c97ef85"
format_stamp: "Formatted at 2026-08-06 00:53:24 on dist-test-slave-44d2"
server_key: "7c13d54a3afc87aa802b188875c2f76b"
server_key_iv: "f6525389a3b2a6519fe94b7018a4e591"
server_key_version: "encryptionkey@0"
I20260806 00:53:24.298928 10595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "f8b501d631744959925894485c97ef85"
format_stamp: "Formatted at 2026-08-06 00:53:24 on dist-test-slave-44d2"
server_key: "7c13d54a3afc87aa802b188875c2f76b"
server_key_iv: "f6525389a3b2a6519fe94b7018a4e591"
server_key_version: "encryptionkey@0"
I20260806 00:53:24.300272 10595 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:24.301095 10615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:24.301270 10595 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:24.301363 10595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "f8b501d631744959925894485c97ef85"
format_stamp: "Formatted at 2026-08-06 00:53:24 on dist-test-slave-44d2"
server_key: "7c13d54a3afc87aa802b188875c2f76b"
server_key_iv: "f6525389a3b2a6519fe94b7018a4e591"
server_key_version: "encryptionkey@0"
I20260806 00:53:24.301445 10595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:24.314244 10595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:24.314560 10595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:24.314713 10595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:24.318843 10595 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:36705
I20260806 00:53:24.318895 10687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:36705 every 8 connection(s)
I20260806 00:53:24.319267 10595 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:24.320369 10688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:24.322763 10688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85: Bootstrap starting.
I20260806 00:53:24.323370 10688 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:24.323632 10688 log.cc:824] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:24.324332 10688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85: No bootstrap required, opened a new log
I20260806 00:53:24.325168 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 10595
I20260806 00:53:24.325299 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:24.325515 3466 external_mini_cluster.cc:1428] Setting key 5639ff6010d6ad80aa0132a25fe8dd41
I20260806 00:53:24.326681 10688 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b501d631744959925894485c97ef85" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36705 } }
I20260806 00:53:24.326869 10688 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:24.326920 10688 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8b501d631744959925894485c97ef85, State: Initialized, Role: FOLLOWER
I20260806 00:53:24.327065 10688 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b501d631744959925894485c97ef85" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36705 } }
I20260806 00:53:24.327165 10688 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:24.327189 10688 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:24.327263 10688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:24.327828 10688 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b501d631744959925894485c97ef85" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36705 } }
I20260806 00:53:24.327919 10688 leader_election.cc:302] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8b501d631744959925894485c97ef85; no voters:
I20260806 00:53:24.328137 10688 leader_election.cc:288] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:24.328176 10693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:24.328285 10693 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [term 1 LEADER]: Becoming Leader. State: Replica: f8b501d631744959925894485c97ef85, State: Running, Role: LEADER
I20260806 00:53:24.328370 10693 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b501d631744959925894485c97ef85" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36705 } }
I20260806 00:53:24.328421 10688 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:24.328743 10693 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8b501d631744959925894485c97ef85. Latest consensus state: current_term: 1 leader_uuid: "f8b501d631744959925894485c97ef85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b501d631744959925894485c97ef85" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36705 } } }
I20260806 00:53:24.328819 10693 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:24.329000 10694 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8b501d631744959925894485c97ef85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8b501d631744959925894485c97ef85" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36705 } } }
I20260806 00:53:24.329075 10694 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:24.329351 10698 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:24.330230 10698 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:24.332096 10698 catalog_manager.cc:1347] Generated new cluster ID: b079381a03de46a396cbea247cdc8644
I20260806 00:53:24.332177 10698 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:53:24.332377 10692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:24.326195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49928 (local address 127.3.98.190:36705)
0806 00:53:24.326430 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:24.326438 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:24.326464 (+ 26us) server_negotiation.cc:407] Connection header received
0806 00:53:24.326639 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:24.326644 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:24.326698 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:24.326806 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:24.327070 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.328681 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.329982 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.330502 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.330639 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:24.331404 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:24.331408 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:24.331408 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:24.331622 (+ 214us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:24.331690 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:24.331707 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:24.331778 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:24.331883 (+ 105us) server_negotiation.cc:299] Negotiation successful
0806 00:53:24.332077 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":102,"threads_started":1}
I20260806 00:53:24.333282 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:53:24.355010 10698 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:24.355537 10698 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:24.359344 10698 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8b501d631744959925894485c97ef85: Generated new TSK 0
I20260806 00:53:24.359551 10698 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 00:53:24.395006 10725 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 00:53:24.395186 10725 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260806 00:53:24.395828 10723 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:24.375244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:36705 (local address 127.0.0.1:49932)
0806 00:53:24.375446 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:24.375458 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:24.375536 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:24.375735 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:24.375736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:24.375738 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0806 00:53:24.375810 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:24.375813 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.376439 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.376440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:24.377404 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:24.377408 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.377754 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.377756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:24.377827 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:24.377850 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 00:53:24.395321 (+ 17471us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41299/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 00:53:24.395422 (+ 101us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.3.98.190:36705: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41299/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":114,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.3.98.190:36705: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41299/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 00:53:24.396248 10692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:24.375348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49932 (local address 127.3.98.190:36705)
0806 00:53:24.375400 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:24.375403 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:24.375525 (+ 122us) server_negotiation.cc:407] Connection header received
0806 00:53:24.375654 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:24.375655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:24.375665 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:24.375720 (+ 55us) server_negotiation.cc:226] Negotiated authn=JWT
0806 00:53:24.375874 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.376357 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.377490 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.377676 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.377729 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:24.377972 (+ 243us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 00:53:24.395167 (+ 17195us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41299/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 00:53:24.396074 (+ 907us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49932: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41299/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":26}
W20260806 00:53:24.396293 10692 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49932: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41299/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
I20260806 00:53:24.396291 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 10595
2026-08-06T00:53:24Z chronyd exiting
I20260806 00:53:24.440181 3466 test_util.cc:175] -----------------------------------------------
I20260806 00:53:24.440291 3466 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785977579314977-3466-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (251 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 00:53:24.441154 3466 mini_oidc.cc:152] Starting JWKS server
I20260806 00:53:24.441855 3466 webserver.cc:460] Webserver started at https://127.0.0.1:41617/ using document root <none> and password file <none>
I20260806 00:53:24.441924 3466 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 00:53:24.442099 3466 webserver.cc:460] Webserver started at http://127.0.0.1:35111/ using document root <none> and password file <none>
2026-08-06T00:53:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:24Z Disabled control of system clock
I20260806 00:53:24.451390 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44605
--webserver_interface=127.3.98.190
--webserver_port=0
--builtin_ntp_servers=127.3.98.148:35633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:44605
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41617/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/testchainca.cert with env {}
W20260806 00:53:24.535749 10734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:24.536000 10734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:24.536044 10734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:24.537235 10734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:24.537309 10734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:24.537330 10734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:24.537350 10734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:24.537384 10734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 00:53:24.537413 10734 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 00:53:24.537442 10734 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41617/jwks.json
I20260806 00:53:24.538987 10734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:35633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:44605
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41617/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:24.539287 10734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:24.539510 10734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:24.544466 10740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:24.544507 10742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:24.544719 10744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:24.544992 10734 server_base.cc:1034] running on GCE node
I20260806 00:53:24.545249 10734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:24.545504 10734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:24.546692 10734 hybrid_clock.cc:648] HybridClock initialized: now 1785977604546677 us; error 52 us; skew 500 ppm
I20260806 00:53:24.548161 10734 webserver.cc:460] Webserver started at http://127.3.98.190:38555/ using document root <none> and password file <none>
I20260806 00:53:24.548424 10734 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:24.548521 10734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:24.548691 10734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:24.549796 10734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "970e5b30e7414304a0524ac90415d5fb"
format_stamp: "Formatted at 2026-08-06 00:53:24 on dist-test-slave-44d2"
server_key: "3a8b970ac241d61ae333f0ecd5ad524c"
server_key_iv: "6d929d742f697b8913478d439261c892"
server_key_version: "encryptionkey@0"
I20260806 00:53:24.550205 10734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "970e5b30e7414304a0524ac90415d5fb"
format_stamp: "Formatted at 2026-08-06 00:53:24 on dist-test-slave-44d2"
server_key: "3a8b970ac241d61ae333f0ecd5ad524c"
server_key_iv: "6d929d742f697b8913478d439261c892"
server_key_version: "encryptionkey@0"
I20260806 00:53:24.551725 10734 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:53:24.552568 10755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:24.552765 10734 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 00:53:24.552871 10734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "970e5b30e7414304a0524ac90415d5fb"
format_stamp: "Formatted at 2026-08-06 00:53:24 on dist-test-slave-44d2"
server_key: "3a8b970ac241d61ae333f0ecd5ad524c"
server_key_iv: "6d929d742f697b8913478d439261c892"
server_key_version: "encryptionkey@0"
I20260806 00:53:24.552989 10734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:24.577075 10734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:24.577450 10734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:24.577636 10734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:24.581795 10734 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:44605
I20260806 00:53:24.581837 10817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:44605 every 8 connection(s)
I20260806 00:53:24.582233 10734 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:24.583249 10818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:24.585772 10818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb: Bootstrap starting.
I20260806 00:53:24.586350 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 10734
I20260806 00:53:24.586436 10818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:24.586467 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:24.586658 3466 external_mini_cluster.cc:1428] Setting key 10a1bd20e86bfc30c919dac6ff877866
I20260806 00:53:24.586819 10818 log.cc:824] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:24.587657 10818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb: No bootstrap required, opened a new log
I20260806 00:53:24.590129 10818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970e5b30e7414304a0524ac90415d5fb" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44605 } }
I20260806 00:53:24.590303 10818 raft_consensus.cc:374] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:24.590335 10818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 970e5b30e7414304a0524ac90415d5fb, State: Initialized, Role: FOLLOWER
I20260806 00:53:24.590454 10818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970e5b30e7414304a0524ac90415d5fb" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44605 } }
I20260806 00:53:24.590533 10818 raft_consensus.cc:388] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:24.590580 10818 raft_consensus.cc:482] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:24.590642 10818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:24.591281 10818 raft_consensus.cc:504] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970e5b30e7414304a0524ac90415d5fb" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44605 } }
I20260806 00:53:24.591404 10818 leader_election.cc:302] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 970e5b30e7414304a0524ac90415d5fb; no voters:
I20260806 00:53:24.591598 10818 leader_election.cc:288] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:24.591624 10825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:24.591751 10825 raft_consensus.cc:686] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [term 1 LEADER]: Becoming Leader. State: Replica: 970e5b30e7414304a0524ac90415d5fb, State: Running, Role: LEADER
I20260806 00:53:24.591832 10825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970e5b30e7414304a0524ac90415d5fb" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44605 } }
I20260806 00:53:24.591887 10818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:24.592180 10826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 970e5b30e7414304a0524ac90415d5fb. Latest consensus state: current_term: 1 leader_uuid: "970e5b30e7414304a0524ac90415d5fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970e5b30e7414304a0524ac90415d5fb" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44605 } } }
I20260806 00:53:24.592278 10826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:24.592427 10827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "970e5b30e7414304a0524ac90415d5fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "970e5b30e7414304a0524ac90415d5fb" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44605 } } }
I20260806 00:53:24.592535 10827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:24.593174 10824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:24.587212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37732 (local address 127.3.98.190:44605)
0806 00:53:24.587436 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:24.587444 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:24.587497 (+ 53us) server_negotiation.cc:407] Connection header received
0806 00:53:24.588100 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:24.588110 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:24.588199 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:24.588314 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:24.588586 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.589452 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.590575 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.591058 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.591151 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:24.592016 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:24.592020 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:24.592021 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:24.592242 (+ 221us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:24.592304 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:24.592331 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:24.592810 (+ 479us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:24.592845 (+ 35us) server_negotiation.cc:299] Negotiation successful
0806 00:53:24.592930 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":77,"threads_started":1}
I20260806 00:53:24.593366 10831 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:24.594282 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:53:24.594328 10831 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:24.595980 10831 catalog_manager.cc:1347] Generated new cluster ID: e039c6f851594b2da65e28660cbe72a5
I20260806 00:53:24.596051 10831 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:53:24.611330 10831 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:24.611971 10831 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:24.618623 10831 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 970e5b30e7414304a0524ac90415d5fb: Generated new TSK 0
I20260806 00:53:24.618845 10831 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 00:53:24.640962 10859 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 00:53:24.641062 10859 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 00:53:24.641408 10824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:24.626921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37746 (local address 127.3.98.190:44605)
0806 00:53:24.626969 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:24.626972 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:24.627075 (+ 103us) server_negotiation.cc:407] Connection header received
0806 00:53:24.627135 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:24.627136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:24.627157 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:24.627219 (+ 62us) server_negotiation.cc:226] Negotiated authn=JWT
0806 00:53:24.627355 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.627847 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.629053 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.629262 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.629319 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:24.629517 (+ 198us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 00:53:24.641221 (+ 11704us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41617/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 00:53:24.641349 (+ 128us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37746: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41617/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":26}
W20260806 00:53:24.641489 10824 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37746: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41617/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260806 00:53:24.641602 10857 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:24.626823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44605 (local address 127.0.0.1:37746)
0806 00:53:24.626985 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:24.627001 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:24.627068 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:24.627229 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:24.627229 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:24.627231 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0806 00:53:24.627298 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:24.627300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.627926 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.627928 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:24.628944 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:24.628948 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.629341 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.629342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:24.629413 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:24.629419 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 00:53:24.641343 (+ 11924us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41617/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 00:53:24.641481 (+ 138us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.3.98.190:44605: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41617/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":93,"threads_started":1}
I20260806 00:53:24.642109 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 10734
2026-08-06T00:53:24Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (249 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 00:53:24.690165 3466 mini_oidc.cc:152] Starting JWKS server
I20260806 00:53:24.690891 3466 webserver.cc:460] Webserver started at https://127.0.0.1:40673/ using document root <none> and password file <none>
I20260806 00:53:24.690938 3466 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 00:53:24.691130 3466 webserver.cc:460] Webserver started at http://127.0.0.1:41219/ using document root <none> and password file <none>
2026-08-06T00:53:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:24Z Disabled control of system clock
I20260806 00:53:24.700268 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:34817
--webserver_interface=127.3.98.190
--webserver_port=0
--builtin_ntp_servers=127.3.98.148:43479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:34817
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40673/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 00:53:24.784864 10866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:24.785089 10866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:24.785112 10866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:24.786315 10866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:24.786357 10866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:24.786370 10866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:24.786386 10866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:24.786440 10866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 00:53:24.786459 10866 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 00:53:24.786487 10866 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40673/jwks.json
I20260806 00:53:24.787860 10866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:34817
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:34817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40673/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:24.788131 10866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:24.788470 10866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:24.793488 10873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:24.793483 10875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:24.793488 10877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:24.793854 10866 server_base.cc:1034] running on GCE node
I20260806 00:53:24.794193 10866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:24.794499 10866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:24.795646 10866 hybrid_clock.cc:648] HybridClock initialized: now 1785977604795627 us; error 35 us; skew 500 ppm
I20260806 00:53:24.797024 10866 webserver.cc:460] Webserver started at http://127.3.98.190:33249/ using document root <none> and password file <none>
I20260806 00:53:24.797262 10866 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:24.797308 10866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:24.797472 10866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:24.798605 10866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "19800eda2e72460ebf1c7555bffc1086"
format_stamp: "Formatted at 2026-08-06 00:53:24 on dist-test-slave-44d2"
server_key: "702ff151ab2d99836a1128ebd223764c"
server_key_iv: "e9f961bcdc40c6d282c2c8d944df6bef"
server_key_version: "encryptionkey@0"
I20260806 00:53:24.799000 10866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "19800eda2e72460ebf1c7555bffc1086"
format_stamp: "Formatted at 2026-08-06 00:53:24 on dist-test-slave-44d2"
server_key: "702ff151ab2d99836a1128ebd223764c"
server_key_iv: "e9f961bcdc40c6d282c2c8d944df6bef"
server_key_version: "encryptionkey@0"
I20260806 00:53:24.800465 10866 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:24.801352 10886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:24.801527 10866 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:24.801640 10866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "19800eda2e72460ebf1c7555bffc1086"
format_stamp: "Formatted at 2026-08-06 00:53:24 on dist-test-slave-44d2"
server_key: "702ff151ab2d99836a1128ebd223764c"
server_key_iv: "e9f961bcdc40c6d282c2c8d944df6bef"
server_key_version: "encryptionkey@0"
I20260806 00:53:24.801716 10866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:24.814033 10866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:24.814404 10866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:24.814567 10866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:24.818966 10866 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:34817
I20260806 00:53:24.819032 10957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:34817 every 8 connection(s)
I20260806 00:53:24.819418 10866 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:24.820132 10958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:24.823146 10958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086: Bootstrap starting.
I20260806 00:53:24.823724 10958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:24.823977 10958 log.cc:824] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:24.824882 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 10866
I20260806 00:53:24.825001 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:24.825040 10958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086: No bootstrap required, opened a new log
I20260806 00:53:24.825199 3466 external_mini_cluster.cc:1428] Setting key 5a05db7b8107b3a9403b02c1f8095c66
I20260806 00:53:24.828030 10958 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19800eda2e72460ebf1c7555bffc1086" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34817 } }
I20260806 00:53:24.828225 10958 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:24.828265 10958 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19800eda2e72460ebf1c7555bffc1086, State: Initialized, Role: FOLLOWER
I20260806 00:53:24.828400 10958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19800eda2e72460ebf1c7555bffc1086" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34817 } }
I20260806 00:53:24.828508 10958 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:24.828548 10958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:24.828590 10958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:24.829373 10958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19800eda2e72460ebf1c7555bffc1086" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34817 } }
I20260806 00:53:24.829475 10958 leader_election.cc:302] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19800eda2e72460ebf1c7555bffc1086; no voters:
I20260806 00:53:24.829668 10958 leader_election.cc:288] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:24.829792 10963 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:24.830013 10963 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [term 1 LEADER]: Becoming Leader. State: Replica: 19800eda2e72460ebf1c7555bffc1086, State: Running, Role: LEADER
I20260806 00:53:24.830087 10958 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:24.830225 10963 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19800eda2e72460ebf1c7555bffc1086" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34817 } }
I20260806 00:53:24.830658 10964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19800eda2e72460ebf1c7555bffc1086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19800eda2e72460ebf1c7555bffc1086" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34817 } } }
I20260806 00:53:24.830816 10964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:24.830657 10965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19800eda2e72460ebf1c7555bffc1086. Latest consensus state: current_term: 1 leader_uuid: "19800eda2e72460ebf1c7555bffc1086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19800eda2e72460ebf1c7555bffc1086" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34817 } } }
I20260806 00:53:24.830952 10965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:24.831176 10972 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:24.831652 10962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:24.825762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58788 (local address 127.3.98.190:34817)
0806 00:53:24.826013 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:24.826021 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:24.826047 (+ 26us) server_negotiation.cc:407] Connection header received
0806 00:53:24.826534 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:24.826542 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:24.826608 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:24.826725 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:24.826978 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.827839 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.829074 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.829585 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.829735 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:24.830581 (+ 846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:24.830585 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:24.830586 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:24.830868 (+ 282us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:24.830942 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:24.830959 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:24.831278 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:24.831315 (+ 37us) server_negotiation.cc:299] Negotiation successful
0806 00:53:24.831399 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":99,"threads_started":1}
I20260806 00:53:24.831749 10972 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:24.832710 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:53:24.834671 10972 catalog_manager.cc:1347] Generated new cluster ID: c92a9af5d22c4871ab7a766bd59600e2
I20260806 00:53:24.834735 10972 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:53:24.857847 10972 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:24.858429 10972 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:24.860991 10972 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19800eda2e72460ebf1c7555bffc1086: Generated new TSK 0
I20260806 00:53:24.861202 10972 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:53:24.875698 10962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:24.871745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58798 (local address 127.3.98.190:34817)
0806 00:53:24.871789 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:24.871792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:24.871869 (+ 77us) server_negotiation.cc:407] Connection header received
0806 00:53:24.871969 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:24.871970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:24.871980 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:24.872040 (+ 60us) server_negotiation.cc:226] Negotiated authn=JWT
0806 00:53:24.872202 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.872816 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.874066 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.874260 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.874318 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:24.874534 (+ 216us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 00:53:24.875488 (+ 954us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40673/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 00:53:24.875623 (+ 135us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58798: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40673/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":19}
W20260806 00:53:24.875759 10962 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58798: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40673/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260806 00:53:24.875829 10993 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:24.871617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:34817 (local address 127.0.0.1:58798)
0806 00:53:24.871805 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:24.871818 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:24.871891 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:24.872056 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:24.872057 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:24.872059 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0806 00:53:24.872129 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:24.872131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.872901 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.872902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:24.873971 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:24.873974 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:24.874351 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:24.874352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:24.874429 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:24.874435 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 00:53:24.875604 (+ 1169us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40673/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 00:53:24.875717 (+ 113us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.3.98.190:34817: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40673/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":105,"threads_started":1}
I20260806 00:53:24.876065 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 10866
E20260806 00:53:24.892186 10994 webserver.cc:533] Webserver: sslize failed:
E20260806 00:53:24.892295 10994 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-06T00:53:24Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (233 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T00:53:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:24Z Disabled control of system clock
I20260806 00:53:24.933516 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:36209
--webserver_interface=127.3.98.190
--webserver_port=0
--builtin_ntp_servers=127.3.98.148:43771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:36209
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/testchainca.cert with env {}
W20260806 00:53:25.017246 10998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:25.017518 10998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:25.017557 10998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:25.018766 10998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:25.018842 10998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:25.018864 10998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:25.018887 10998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:25.018916 10998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 00:53:25.018941 10998 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 00:53:25.018965 10998 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 00:53:25.020500 10998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:36209
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:36209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:25.020804 10998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:25.021040 10998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:25.025974 11011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:25.026017 11005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:25.026036 11008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:25.026201 10998 server_base.cc:1034] running on GCE node
I20260806 00:53:25.026434 10998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:25.026682 10998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:25.027828 10998 hybrid_clock.cc:648] HybridClock initialized: now 1785977605027810 us; error 47 us; skew 500 ppm
I20260806 00:53:25.029208 10998 webserver.cc:460] Webserver started at http://127.3.98.190:37691/ using document root <none> and password file <none>
I20260806 00:53:25.029425 10998 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:25.029476 10998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:25.029580 10998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:25.030649 10998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "8d8b263a7f384d9ebc77765a68c85c3f"
format_stamp: "Formatted at 2026-08-06 00:53:25 on dist-test-slave-44d2"
server_key: "d2769965b4efffd482b424a397a85191"
server_key_iv: "db6bfda7024a22f8ae426a0ddcdcf85e"
server_key_version: "encryptionkey@0"
I20260806 00:53:25.030973 10998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "8d8b263a7f384d9ebc77765a68c85c3f"
format_stamp: "Formatted at 2026-08-06 00:53:25 on dist-test-slave-44d2"
server_key: "d2769965b4efffd482b424a397a85191"
server_key_iv: "db6bfda7024a22f8ae426a0ddcdcf85e"
server_key_version: "encryptionkey@0"
I20260806 00:53:25.032330 10998 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:25.033155 11017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:25.033316 10998 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:25.033409 10998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "8d8b263a7f384d9ebc77765a68c85c3f"
format_stamp: "Formatted at 2026-08-06 00:53:25 on dist-test-slave-44d2"
server_key: "d2769965b4efffd482b424a397a85191"
server_key_iv: "db6bfda7024a22f8ae426a0ddcdcf85e"
server_key_version: "encryptionkey@0"
I20260806 00:53:25.033493 10998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:25.056293 10998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:25.056689 10998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:25.056815 10998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:25.060705 10998 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:36209
I20260806 00:53:25.060766 11082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:36209 every 8 connection(s)
I20260806 00:53:25.061123 10998 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:25.062144 11083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:25.064565 11083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f: Bootstrap starting.
I20260806 00:53:25.065207 11083 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:25.065527 11083 log.cc:824] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:25.066263 11083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f: No bootstrap required, opened a new log
I20260806 00:53:25.067896 11083 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d8b263a7f384d9ebc77765a68c85c3f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36209 } }
I20260806 00:53:25.068073 11083 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:25.068120 11083 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d8b263a7f384d9ebc77765a68c85c3f, State: Initialized, Role: FOLLOWER
I20260806 00:53:25.068329 11083 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d8b263a7f384d9ebc77765a68c85c3f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36209 } }
I20260806 00:53:25.068372 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 10998
I20260806 00:53:25.068435 11083 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:25.068473 11083 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:25.068509 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:25.068552 11083 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:25.068724 3466 external_mini_cluster.cc:1428] Setting key f85cb34f9ec5d5fea89e0e89bd827bbb
I20260806 00:53:25.069391 11083 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d8b263a7f384d9ebc77765a68c85c3f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36209 } }
I20260806 00:53:25.069509 11083 leader_election.cc:302] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d8b263a7f384d9ebc77765a68c85c3f; no voters:
I20260806 00:53:25.069671 11083 leader_election.cc:288] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:25.069722 11090 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:25.069878 11090 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [term 1 LEADER]: Becoming Leader. State: Replica: 8d8b263a7f384d9ebc77765a68c85c3f, State: Running, Role: LEADER
I20260806 00:53:25.069941 11083 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:25.069969 11090 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d8b263a7f384d9ebc77765a68c85c3f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36209 } }
I20260806 00:53:25.070396 11090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d8b263a7f384d9ebc77765a68c85c3f. Latest consensus state: current_term: 1 leader_uuid: "8d8b263a7f384d9ebc77765a68c85c3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d8b263a7f384d9ebc77765a68c85c3f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36209 } } }
I20260806 00:53:25.070488 11090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:25.070598 11092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d8b263a7f384d9ebc77765a68c85c3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d8b263a7f384d9ebc77765a68c85c3f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36209 } } }
I20260806 00:53:25.070708 11102 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:25.070719 11092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:25.071285 11102 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:25.073074 11102 catalog_manager.cc:1347] Generated new cluster ID: 8f6219bb883b457e939f2a263f009e58
I20260806 00:53:25.073174 11102 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:53:25.075044 11088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:25.069247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33690 (local address 127.3.98.190:36209)
0806 00:53:25.069508 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:25.069518 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:25.069554 (+ 36us) server_negotiation.cc:407] Connection header received
0806 00:53:25.069681 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:25.069688 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:25.069769 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:25.070192 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:25.070289 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:25.071801 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:25.073007 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:25.073466 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:25.073621 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:25.074337 (+ 716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:25.074341 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:25.074341 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:25.074526 (+ 185us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:25.074560 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:25.074572 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:25.074652 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:25.074730 (+ 78us) server_negotiation.cc:299] Negotiation successful
0806 00:53:25.074816 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":98,"threads_started":1}
I20260806 00:53:25.075927 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:53:25.079361 11102 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:25.079838 11102 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:25.082957 11102 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d8b263a7f384d9ebc77765a68c85c3f: Generated new TSK 0
I20260806 00:53:25.083154 11102 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:53:25.145257 11088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:25.092825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33694 (local address 127.3.98.190:36209)
0806 00:53:25.092890 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:25.092893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:25.092974 (+ 81us) server_negotiation.cc:407] Connection header received
0806 00:53:25.093039 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:25.093040 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:25.093054 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:25.093137 (+ 83us) server_negotiation.cc:226] Negotiated authn=JWT
0806 00:53:25.093260 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:25.094075 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:25.094868 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:25.095222 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:25.095295 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:25.095471 (+ 176us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 00:53:25.144939 (+ 49468us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 00:53:25.145171 (+ 232us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33694: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":38}
W20260806 00:53:25.145351 11088 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33694: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260806 00:53:25.145417 11124 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:25.092739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:36209 (local address 127.0.0.1:33694)
0806 00:53:25.092917 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:25.092927 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:25.092984 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:25.093146 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:25.093147 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:25.093149 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0806 00:53:25.093202 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:25.093204 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:25.094182 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:25.094183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:25.094779 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:25.094780 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:25.095309 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:25.095310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:25.095362 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:25.095367 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 00:53:25.145123 (+ 49756us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 00:53:25.145286 (+ 163us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.3.98.190:36209: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":107,"threads_started":1}
I20260806 00:53:25.145784 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 10998
2026-08-06T00:53:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (246 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (95 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (93 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:25 dist-test-slave-44d2 krb5kdc[11138](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:25 dist-test-slave-44d2 krb5kdc[11138](info): set up 2 sockets
Aug 06 00:53:25 dist-test-slave-44d2 krb5kdc[11138](info): commencing operation
krb5kdc: starting...
W20260806 00:53:26.598042 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:26 dist-test-slave-44d2 krb5kdc[11138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:53:26.734287 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:35877
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:35737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:35877
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:26.819626 11161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:26.819886 11161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:26.819926 11161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:26.821110 11161 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:26.821187 11161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:26.821211 11161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:26.821233 11161 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:26.821261 11161 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:26.822712 11161 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:35737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:35877
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:35877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:26.823007 11161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:26.823235 11161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:26.828262 11170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:26.828277 11172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:26.828305 11168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:26.828622 11161 server_base.cc:1034] running on GCE node
I20260806 00:53:26.828894 11161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:26.829196 11161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:26.830360 11161 hybrid_clock.cc:648] HybridClock initialized: now 1785977606830353 us; error 40 us; skew 500 ppm
Aug 06 00:53:26 dist-test-slave-44d2 krb5kdc[11138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977606, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:26.833165 11161 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:53:26.833652 11161 webserver.cc:460] Webserver started at http://127.3.98.190:34281/ using document root <none> and password file <none>
I20260806 00:53:26.833885 11161 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:26.833933 11161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:26.834093 11161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:26.835202 11161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "9ed6ddc56836458aa9eebdfea3c8650e"
format_stamp: "Formatted at 2026-08-06 00:53:26 on dist-test-slave-44d2"
server_key: "b434ee3498537f9178942a8d2830a707"
server_key_iv: "fd41f3d1e1f57d1371ffcf466e2cdfec"
server_key_version: "encryptionkey@0"
I20260806 00:53:26.835589 11161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "9ed6ddc56836458aa9eebdfea3c8650e"
format_stamp: "Formatted at 2026-08-06 00:53:26 on dist-test-slave-44d2"
server_key: "b434ee3498537f9178942a8d2830a707"
server_key_iv: "fd41f3d1e1f57d1371ffcf466e2cdfec"
server_key_version: "encryptionkey@0"
I20260806 00:53:26.837073 11161 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:26.838011 11179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:26.838189 11161 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:26.838320 11161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "9ed6ddc56836458aa9eebdfea3c8650e"
format_stamp: "Formatted at 2026-08-06 00:53:26 on dist-test-slave-44d2"
server_key: "b434ee3498537f9178942a8d2830a707"
server_key_iv: "fd41f3d1e1f57d1371ffcf466e2cdfec"
server_key_version: "encryptionkey@0"
I20260806 00:53:26.838410 11161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:26.852031 11161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:26.854607 11161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:26.854779 11161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:26.858896 11161 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:35877
I20260806 00:53:26.858966 11262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:35877 every 8 connection(s)
I20260806 00:53:26.859359 11161 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:26.860255 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 11161
I20260806 00:53:26.860376 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:26.860375 11263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:26.860589 3466 external_mini_cluster.cc:1428] Setting key 9e1ec41eb27955bb52be00a7021a8d2d
I20260806 00:53:26.863945 11263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e: Bootstrap starting.
I20260806 00:53:26.864682 11263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:26.864991 11263 log.cc:824] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:26.865787 11263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e: No bootstrap required, opened a new log
Aug 06 00:53:26 dist-test-slave-44d2 krb5kdc[11138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:26.868527 11263 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed6ddc56836458aa9eebdfea3c8650e" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35877 } }
I20260806 00:53:26.868710 11263 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:26.868757 11263 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ed6ddc56836458aa9eebdfea3c8650e, State: Initialized, Role: FOLLOWER
I20260806 00:53:26.868935 11263 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed6ddc56836458aa9eebdfea3c8650e" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35877 } }
I20260806 00:53:26.869035 11263 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:26.869068 11263 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:26.869113 11263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:26.869791 11263 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed6ddc56836458aa9eebdfea3c8650e" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35877 } }
I20260806 00:53:26.869938 11263 leader_election.cc:302] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ed6ddc56836458aa9eebdfea3c8650e; no voters:
I20260806 00:53:26.870155 11263 leader_election.cc:288] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:26.870213 11270 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:26.870365 11270 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [term 1 LEADER]: Becoming Leader. State: Replica: 9ed6ddc56836458aa9eebdfea3c8650e, State: Running, Role: LEADER
I20260806 00:53:26.870455 11270 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed6ddc56836458aa9eebdfea3c8650e" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35877 } }
I20260806 00:53:26.870489 11263 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:26.870770 11270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ed6ddc56836458aa9eebdfea3c8650e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed6ddc56836458aa9eebdfea3c8650e" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35877 } } }
I20260806 00:53:26.870851 11270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:26.870988 11270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ed6ddc56836458aa9eebdfea3c8650e. Latest consensus state: current_term: 1 leader_uuid: "9ed6ddc56836458aa9eebdfea3c8650e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ed6ddc56836458aa9eebdfea3c8650e" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35877 } } }
I20260806 00:53:26.871058 11270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:26.871228 11275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:26.872927 11266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:26.861267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33938 (local address 127.3.98.190:35877)
0806 00:53:26.861504 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:26.861515 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:26.861552 (+ 37us) server_negotiation.cc:407] Connection header received
0806 00:53:26.862107 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:26.862118 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:26.862198 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:26.862356 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:26.862970 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:26.864344 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:26.865235 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:26.865769 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:26.865886 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:26.868643 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:26.868647 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:26.868648 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:26.868659 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:26.870912 (+ 2253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:26.871383 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:26.871386 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:26.871386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:26.871508 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:26.871747 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:26.871748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:26.871748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:26.872088 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:26.872261 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:26.872594 (+ 333us) server_negotiation.cc:299] Negotiation successful
0806 00:53:26.872746 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":114,"threads_started":1}
I20260806 00:53:26.876698 11275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:26.878378 11275 catalog_manager.cc:1347] Generated new cluster ID: eda6281cb8e14dd68d60fc4c35a6ba82
I20260806 00:53:26.878453 11275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:53:26.885241 11275 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:26.885883 11275 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:26.891518 11275 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ed6ddc56836458aa9eebdfea3c8650e: Generated new TSK 0
I20260806 00:53:26.891736 11275 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:53:26.932696 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35877
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:35737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:27.030411 11297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:27.030694 11297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:27.030743 11297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:27.032064 11297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:27.032147 11297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:27.032203 11297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:27.034065 11297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:35737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35877
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:27.034365 11297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:27.034632 11297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:27.040464 11304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:27.040439 11303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:27.040455 11307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:27.040688 11297 server_base.cc:1034] running on GCE node
I20260806 00:53:27.041046 11297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:27.041337 11297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:27.042548 11297 hybrid_clock.cc:648] HybridClock initialized: now 1785977607042532 us; error 26 us; skew 500 ppm
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:27.045246 11297 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:53:27.045666 11297 webserver.cc:460] Webserver started at http://127.3.98.129:37217/ using document root <none> and password file <none>
I20260806 00:53:27.045864 11297 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:27.045907 11297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:27.046001 11297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:27.047030 11297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "91387fb98dc04223b0e9f388d262865b"
format_stamp: "Formatted at 2026-08-06 00:53:27 on dist-test-slave-44d2"
server_key: "7a561255e3d47d1c341c77c542f3bfca"
server_key_iv: "010d07575cfefb4629fba26718932845"
server_key_version: "encryptionkey@0"
I20260806 00:53:27.047395 11297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "91387fb98dc04223b0e9f388d262865b"
format_stamp: "Formatted at 2026-08-06 00:53:27 on dist-test-slave-44d2"
server_key: "7a561255e3d47d1c341c77c542f3bfca"
server_key_iv: "010d07575cfefb4629fba26718932845"
server_key_version: "encryptionkey@0"
I20260806 00:53:27.048779 11297 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 00:53:27.049574 11315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:27.049758 11297 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:27.049847 11297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "91387fb98dc04223b0e9f388d262865b"
format_stamp: "Formatted at 2026-08-06 00:53:27 on dist-test-slave-44d2"
server_key: "7a561255e3d47d1c341c77c542f3bfca"
server_key_iv: "010d07575cfefb4629fba26718932845"
server_key_version: "encryptionkey@0"
I20260806 00:53:27.049903 11297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:27.072129 11297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:27.075094 11297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:27.075215 11297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:27.075408 11297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:27.075783 11297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:27.075836 11297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:27.075861 11297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:27.075937 11297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:27.081950 11297 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:40111
I20260806 00:53:27.082037 11455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:40111 every 8 connection(s)
I20260806 00:53:27.082392 11297 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:27.090026 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 11297
I20260806 00:53:27.090199 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:27.090437 3466 external_mini_cluster.cc:1428] Setting key 507c387fc9fe57361e365def68d995e0
I20260806 00:53:27.093652 11458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:27.083194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35877 (local address 127.3.98.129:51947)
0806 00:53:27.083387 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:27.083431 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:27.084441 (+ 1010us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:27.084750 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:27.084753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:27.085041 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:27.085263 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:27.085268 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.086006 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.086007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:27.086839 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:27.086842 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.087222 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.087223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:27.087337 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:27.087863 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:27.087872 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:27.089689 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:27.091875 (+ 2186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:27.091884 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:27.091887 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:27.092238 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:27.092505 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:27.092506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:27.092507 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:27.092689 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:27.092988 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:27.092995 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:27.093179 (+ 184us) client_negotiation.cc:769] Sending connection context
0806 00:53:27.093302 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 00:53:27.093470 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":114,"threads_started":1}
I20260806 00:53:27.093724 11266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:27.083244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:51947 (local address 127.3.98.190:35877)
0806 00:53:27.083304 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:27.083306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:27.083519 (+ 213us) server_negotiation.cc:407] Connection header received
0806 00:53:27.084623 (+ 1104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:27.084625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:27.084636 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:27.084684 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:27.085355 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.085910 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.086924 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.087138 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.087194 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:27.089788 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:27.089789 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:27.089789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:27.089797 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:27.091783 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:27.092322 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:27.092323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:27.092323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:27.092409 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:27.092763 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:27.092764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:27.092764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:27.092912 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:27.092975 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:27.093472 (+ 497us) server_negotiation.cc:299] Negotiation successful
0806 00:53:27.093591 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 00:53:27.094266 11456 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35877
I20260806 00:53:27.094388 11456 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:27.094607 11456 heartbeater.cc:511] Master 127.3.98.190:35877 requested a full tablet report, sending...
I20260806 00:53:27.095438 11206 ts_manager.cc:194] Registered new tserver with Master: 91387fb98dc04223b0e9f388d262865b (127.3.98.129:40111)
I20260806 00:53:27.096395 11206 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:51947
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:53:27.119825 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35877
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:35737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:27.205034 11462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:27.205289 11462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:27.205328 11462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:27.206550 11462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:27.206624 11462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:27.206672 11462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:27.208220 11462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:35737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35877
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:27.208555 11462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:27.208815 11462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:27.214208 11471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:27.214277 11473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:27.214221 11470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:27.214500 11462 server_base.cc:1034] running on GCE node
I20260806 00:53:27.214718 11462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:27.214931 11462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:27.216081 11462 hybrid_clock.cc:648] HybridClock initialized: now 1785977607216066 us; error 35 us; skew 500 ppm
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:27.218743 11462 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:53:27.219190 11462 webserver.cc:460] Webserver started at http://127.3.98.130:41565/ using document root <none> and password file <none>
I20260806 00:53:27.219427 11462 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:27.219472 11462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:27.219563 11462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:27.220643 11462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "9bf3939f36a34285a4a23fa0de9a7a10"
format_stamp: "Formatted at 2026-08-06 00:53:27 on dist-test-slave-44d2"
server_key: "e07ee3d3f324de0a4b354d0833e87f33"
server_key_iv: "5830767a8a8c0f8d72f87f1faa58871f"
server_key_version: "encryptionkey@0"
I20260806 00:53:27.220963 11462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "9bf3939f36a34285a4a23fa0de9a7a10"
format_stamp: "Formatted at 2026-08-06 00:53:27 on dist-test-slave-44d2"
server_key: "e07ee3d3f324de0a4b354d0833e87f33"
server_key_iv: "5830767a8a8c0f8d72f87f1faa58871f"
server_key_version: "encryptionkey@0"
I20260806 00:53:27.222327 11462 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:27.223040 11486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:27.223244 11462 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:27.223328 11462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "9bf3939f36a34285a4a23fa0de9a7a10"
format_stamp: "Formatted at 2026-08-06 00:53:27 on dist-test-slave-44d2"
server_key: "e07ee3d3f324de0a4b354d0833e87f33"
server_key_iv: "5830767a8a8c0f8d72f87f1faa58871f"
server_key_version: "encryptionkey@0"
I20260806 00:53:27.223381 11462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:27.235002 11462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:27.237092 11462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:27.237201 11462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:27.237372 11462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:27.237694 11462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:27.237749 11462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:27.237790 11462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:27.237818 11462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:27.243849 11462 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:41255
I20260806 00:53:27.243896 11634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:41255 every 8 connection(s)
I20260806 00:53:27.244220 11462 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:27.244912 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 11462
I20260806 00:53:27.245046 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:27.245253 3466 external_mini_cluster.cc:1428] Setting key ca54c9f9d90ef420611f672219c25519
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:27.255716 11266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:27.245034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:54087 (local address 127.3.98.190:35877)
0806 00:53:27.245098 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:27.245101 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:27.245382 (+ 281us) server_negotiation.cc:407] Connection header received
0806 00:53:27.246692 (+ 1310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:27.246693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:27.246702 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:27.246741 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:27.247630 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.248129 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.249697 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.249917 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.249985 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:27.252471 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:27.252472 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:27.252473 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:27.252502 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:27.254288 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:27.254687 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:27.254689 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:27.254689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:27.254752 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:27.254998 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:27.255000 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:27.255000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:27.255164 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:27.255251 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:27.255497 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 00:53:27.255609 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 00:53:27.255738 11638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:27.245004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35877 (local address 127.3.98.130:54087)
0806 00:53:27.245199 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:27.245253 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:27.246584 (+ 1331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:27.246820 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:27.246825 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:27.247246 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:27.247535 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:27.247541 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.248209 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.248211 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:27.249602 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:27.249606 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.250013 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.250014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:27.250171 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:27.250732 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:27.250744 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:27.252376 (+ 1632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:27.254372 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:27.254378 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:27.254380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:27.254603 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:27.254826 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:27.254827 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:27.254828 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:27.254927 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:27.255242 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:27.255246 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:27.255358 (+ 112us) client_negotiation.cc:769] Sending connection context
0806 00:53:27.255439 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 00:53:27.255570 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
I20260806 00:53:27.256286 11636 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35877
I20260806 00:53:27.256407 11636 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:27.256659 11636 heartbeater.cc:511] Master 127.3.98.190:35877 requested a full tablet report, sending...
I20260806 00:53:27.257030 11206 ts_manager.cc:194] Registered new tserver with Master: 9bf3939f36a34285a4a23fa0de9a7a10 (127.3.98.130:41255)
I20260806 00:53:27.257542 11206 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:54087
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:53:27.275713 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35877
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:35737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:27.358227 11642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:27.358461 11642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:27.358502 11642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:27.359705 11642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:27.359767 11642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:27.359812 11642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:27.361456 11642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:35737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35877
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:27.361735 11642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:27.361968 11642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:27.367223 11650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:27.367334 11642 server_base.cc:1034] running on GCE node
W20260806 00:53:27.367204 11648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:27.367467 11647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:27.367735 11642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:27.367944 11642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:27.369094 11642 hybrid_clock.cc:648] HybridClock initialized: now 1785977607369077 us; error 36 us; skew 500 ppm
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:27.372035 11642 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:53:27.372531 11642 webserver.cc:460] Webserver started at http://127.3.98.131:46633/ using document root <none> and password file <none>
I20260806 00:53:27.372794 11642 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:27.372866 11642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:27.373013 11642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:27.374082 11642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "b0605c9d6c51431e9ef7af2579af711a"
format_stamp: "Formatted at 2026-08-06 00:53:27 on dist-test-slave-44d2"
server_key: "5a37c0869a39dd890b1b03ef3eff11c5"
server_key_iv: "f0728f4e2a6e2d31029cf9f759cb25f3"
server_key_version: "encryptionkey@0"
I20260806 00:53:27.374477 11642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "b0605c9d6c51431e9ef7af2579af711a"
format_stamp: "Formatted at 2026-08-06 00:53:27 on dist-test-slave-44d2"
server_key: "5a37c0869a39dd890b1b03ef3eff11c5"
server_key_iv: "f0728f4e2a6e2d31029cf9f759cb25f3"
server_key_version: "encryptionkey@0"
I20260806 00:53:27.375850 11642 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:53:27.376617 11662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:27.376801 11642 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:27.376900 11642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "b0605c9d6c51431e9ef7af2579af711a"
format_stamp: "Formatted at 2026-08-06 00:53:27 on dist-test-slave-44d2"
server_key: "5a37c0869a39dd890b1b03ef3eff11c5"
server_key_iv: "f0728f4e2a6e2d31029cf9f759cb25f3"
server_key_version: "encryptionkey@0"
I20260806 00:53:27.376989 11642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:27.395401 11642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:27.397718 11642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:27.397879 11642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:27.398108 11642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:27.398428 11642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:27.398497 11642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:27.398540 11642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:27.398567 11642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:27.404809 11642 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:40869
I20260806 00:53:27.404867 11812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:40869 every 8 connection(s)
I20260806 00:53:27.405263 11642 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:27.410902 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 11642
I20260806 00:53:27.411015 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:27.411221 3466 external_mini_cluster.cc:1428] Setting key 701deaacb013f7a3213129c514d53bef
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:27.415855 11266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:27.406132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:41847 (local address 127.3.98.190:35877)
0806 00:53:27.406180 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:27.406182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:27.406459 (+ 277us) server_negotiation.cc:407] Connection header received
0806 00:53:27.407471 (+ 1012us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:27.407472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:27.407486 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:27.407539 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:27.408222 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.408801 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.409863 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.410064 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.410151 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:27.412849 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:27.412851 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:27.412851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:27.412858 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:27.414651 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:27.415066 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:27.415075 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:27.415075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:27.415132 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:27.415351 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:27.415352 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:27.415352 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:27.415458 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:27.415508 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:27.415722 (+ 214us) server_negotiation.cc:299] Negotiation successful
0806 00:53:27.415790 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:53:27.416021 11815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:27.406128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35877 (local address 127.3.98.131:41847)
0806 00:53:27.406318 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:27.406356 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:27.407345 (+ 989us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:27.407625 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:27.407629 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:27.407908 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:27.408115 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:27.408119 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.408902 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.408903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:27.409751 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:27.409754 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.410162 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.410164 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:27.410293 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:27.410812 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:27.410824 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:27.412764 (+ 1940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:27.414732 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:27.414738 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:27.414740 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:27.414995 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:27.415193 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:27.415193 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:27.415194 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:27.415295 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:27.415498 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:27.415501 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:27.415615 (+ 114us) client_negotiation.cc:769] Sending connection context
0806 00:53:27.415694 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 00:53:27.415816 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":96,"threads_started":1}
I20260806 00:53:27.416546 11813 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35877
I20260806 00:53:27.416677 11813 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:27.416860 11813 heartbeater.cc:511] Master 127.3.98.190:35877 requested a full tablet report, sending...
I20260806 00:53:27.417268 11206 ts_manager.cc:194] Registered new tserver with Master: b0605c9d6c51431e9ef7af2579af711a (127.3.98.131:40869)
I20260806 00:53:27.417616 11206 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:41847
I20260806 00:53:27.423172 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/test-admin.keytab.
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:27.441249 3466 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 00:53:27.443300 11820 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:27.442358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41084 (local address 127.3.98.129:40111)
0806 00:53:27.442547 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:27.442554 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:27.442568 (+ 14us) server_negotiation.cc:407] Connection header received
0806 00:53:27.442608 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:27.442610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:27.442625 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:27.442714 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:27.443205 (+ 491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41084: BlockingRecv error: recv got EOF from 127.0.0.1:41084 (error 108)
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":88,"threads_started":1}
W20260806 00:53:27.443382 3466 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/krb5cc' of type FILE
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:27.444370 3466 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:27.445389 3466 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.129@KRBTEST.COM
I20260806 00:53:27.453783 11820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:27.446032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41090 (local address 127.3.98.129:40111)
0806 00:53:27.446086 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:27.446088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:27.446105 (+ 17us) server_negotiation.cc:407] Connection header received
0806 00:53:27.446152 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:27.446153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:27.446181 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:27.446253 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:27.446660 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.447440 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.448157 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.448554 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.448616 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:27.450777 (+ 2161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:27.450786 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:27.450786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:27.450793 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:27.452661 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:27.452986 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:27.452989 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:27.452989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:27.453047 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:27.453269 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:27.453270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:27.453270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:27.453417 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:27.453530 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:27.453638 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 00:53:27.453704 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260806 00:53:27.455729 11820 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:27.455107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41098 (local address 127.3.98.129:40111)
0806 00:53:27.455161 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:27.455164 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:27.455226 (+ 62us) server_negotiation.cc:407] Connection header received
0806 00:53:27.455298 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:27.455299 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:27.455313 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:27.455380 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:27.455677 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41098: BlockingRecv error: recv got EOF from 127.0.0.1:41098 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260806 00:53:27.455878 3466 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/krb5cc' of type FILE
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:27.456848 3466 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:27.457702 3466 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.129@KRBTEST.COM
I20260806 00:53:27.464717 11820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:27.458177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41104 (local address 127.3.98.129:40111)
0806 00:53:27.458226 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:27.458228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:27.458238 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:27.458309 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:27.458309 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:27.458320 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:27.458388 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:27.458749 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.459225 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.459916 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.460147 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.460227 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:27.462254 (+ 2027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:27.462255 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:27.462256 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:27.462262 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:27.463733 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:27.464039 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:27.464039 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:27.464040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:27.464090 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:27.464253 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:27.464253 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:27.464254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:27.464338 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:27.464404 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:27.464553 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 00:53:27.464614 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
W20260806 00:53:27.466176 11820 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:27.465680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41114 (local address 127.3.98.129:40111)
0806 00:53:27.465745 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:27.465747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:27.465771 (+ 24us) server_negotiation.cc:407] Connection header received
0806 00:53:27.465816 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:27.465816 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:27.465823 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:27.465866 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:27.466114 (+ 248us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41114: BlockingRecv error: recv got EOF from 127.0.0.1:41114 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260806 00:53:27.466234 3466 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785977579314977-3466-0/krb5kdc/krb5cc' of type FILE
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:27.467176 3466 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:27.467994 3466 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11138](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977607, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.129@KRBTEST.COM
I20260806 00:53:27.475224 11820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:27.468441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41118 (local address 127.3.98.129:40111)
0806 00:53:27.468652 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:27.468654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:27.468664 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:27.468728 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:27.468729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:27.468736 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:27.468789 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:27.469219 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.469668 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.470344 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:27.470581 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:27.470633 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:27.472819 (+ 2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:27.472820 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:27.472820 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:27.472826 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:27.474047 (+ 1221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:27.474429 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:27.474430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:27.474430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:27.474479 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:27.474660 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:27.474661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:27.474661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:27.474743 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:27.474808 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:27.475035 (+ 227us) server_negotiation.cc:299] Negotiation successful
0806 00:53:27.475122 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183}
I20260806 00:53:27.475905 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 11297
I20260806 00:53:27.487066 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 11462
I20260806 00:53:27.500289 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 11642
I20260806 00:53:27.509258 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 11161
2026-08-06T00:53:27Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2174 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11841](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11841](info): set up 2 sockets
Aug 06 00:53:27 dist-test-slave-44d2 krb5kdc[11841](info): commencing operation
krb5kdc: starting...
W20260806 00:53:28.799737 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.265s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:28 dist-test-slave-44d2 krb5kdc[11841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:28Z Disabled control of system clock
WARNING: no policy specified for oryx/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.190.keytab.
Entry for principal oryx/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.190.keytab.
I20260806 00:53:28.931689 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:35873
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.190.keytab
--principal=oryx/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:35873
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:29.018468 11855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:29.018729 11855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:29.018775 11855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:29.019953 11855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:29.020025 11855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:29.020048 11855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:29.020081 11855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:29.020124 11855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:29.021657 11855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:35873
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.190.keytab
--principal=oryx/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:35873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:29.021944 11855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:29.022176 11855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:29.027136 11864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:29.027197 11860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:29.027215 11861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:29.027382 11855 server_base.cc:1034] running on GCE node
I20260806 00:53:29.027660 11855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:29.027976 11855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:29.029151 11855 hybrid_clock.cc:648] HybridClock initialized: now 1785977609029137 us; error 31 us; skew 500 ppm
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:29.036741 11855 init.cc:377] Logged in from keytab as oryx/127.3.98.190@KRBTEST.COM (short username oryx)
I20260806 00:53:29.037285 11855 webserver.cc:460] Webserver started at http://127.3.98.190:36647/ using document root <none> and password file <none>
I20260806 00:53:29.037521 11855 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:29.037592 11855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:29.037751 11855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:29.038861 11855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "7bef2a3e691043d78c4315565b15c55c"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "0fe6f4c3b9e44141c58020b2726777a1"
server_key_iv: "39a7a777fec3c27add3157fddeb29f8a"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.039252 11855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "7bef2a3e691043d78c4315565b15c55c"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "0fe6f4c3b9e44141c58020b2726777a1"
server_key_iv: "39a7a777fec3c27add3157fddeb29f8a"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.040679 11855 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260806 00:53:29.041472 11877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.041656 11855 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:29.041767 11855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "7bef2a3e691043d78c4315565b15c55c"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "0fe6f4c3b9e44141c58020b2726777a1"
server_key_iv: "39a7a777fec3c27add3157fddeb29f8a"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.041849 11855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:29.057123 11855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:29.059317 11855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:29.059496 11855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:29.064177 11855 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:35873
I20260806 00:53:29.064213 11951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:35873 every 8 connection(s)
I20260806 00:53:29.064647 11855 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:29.065809 11952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:29.067899 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 11855
I20260806 00:53:29.068018 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:29.068240 3466 external_mini_cluster.cc:1428] Setting key 25ccdee993ce6b6befaa0a98584d5d8b
I20260806 00:53:29.068298 11952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c: Bootstrap starting.
I20260806 00:53:29.069096 11952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:29.069424 11952 log.cc:824] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:29.070288 11952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c: No bootstrap required, opened a new log
I20260806 00:53:29.071811 11952 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } }
I20260806 00:53:29.072002 11952 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:29.072044 11952 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bef2a3e691043d78c4315565b15c55c, State: Initialized, Role: FOLLOWER
I20260806 00:53:29.072168 11952 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } }
I20260806 00:53:29.072268 11952 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:29.072310 11952 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:29.072356 11952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:29.073081 11952 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } }
I20260806 00:53:29.073176 11952 leader_election.cc:302] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bef2a3e691043d78c4315565b15c55c; no voters:
I20260806 00:53:29.073403 11952 leader_election.cc:288] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:29.073457 11962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:29.073660 11962 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [term 1 LEADER]: Becoming Leader. State: Replica: 7bef2a3e691043d78c4315565b15c55c, State: Running, Role: LEADER
I20260806 00:53:29.073684 11952 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:29.073812 11962 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } }
I20260806 00:53:29.074288 11963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } }
I20260806 00:53:29.074376 11963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:29.074658 11964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bef2a3e691043d78c4315565b15c55c. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } }
I20260806 00:53:29.075098 11964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:29.075148 11966 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:29.075857 11966 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
I20260806 00:53:29.077785 11966 catalog_manager.cc:1347] Generated new cluster ID: 1f988396248f42d78eb9c509cb2ac5c1
I20260806 00:53:29.077840 11966 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:53:29.080920 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.068842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45028 (local address 127.3.98.190:35873)
0806 00:53:29.069040 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:29.069049 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:29.069084 (+ 35us) server_negotiation.cc:407] Connection header received
0806 00:53:29.069664 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:29.069676 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:29.069743 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:29.069894 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:29.070736 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.071607 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.072917 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.073480 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.073613 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.076918 (+ 3305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:29.076922 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:29.076922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:29.076941 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:29.079095 (+ 2154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.079570 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.079573 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.079574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.079692 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.079936 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.079937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.079937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.080236 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:29.080384 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:29.080564 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 00:53:29.080705 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":93,"threads_started":1}
I20260806 00:53:29.085253 11966 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:29.086009 11966 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:29.092684 11966 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c: Generated new TSK 0
I20260806 00:53:29.092907 11966 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab.
Entry for principal oryx/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab.
I20260806 00:53:29.132450 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35873
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab
--principal=oryx/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:29.220209 11989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:29.220448 11989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:29.220492 11989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:29.221692 11989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:29.221763 11989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:29.221812 11989 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:29.223316 11989 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab
--principal=oryx/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:29.223604 11989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:29.223840 11989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:29.228943 11995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:29.228947 11996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:29.229090 11999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:29.229568 11989 server_base.cc:1034] running on GCE node
I20260806 00:53:29.229795 11989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:29.230001 11989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:29.231175 11989 hybrid_clock.cc:648] HybridClock initialized: now 1785977609231166 us; error 33 us; skew 500 ppm
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:29.233959 11989 init.cc:377] Logged in from keytab as oryx/127.3.98.129@KRBTEST.COM (short username oryx)
I20260806 00:53:29.234412 11989 webserver.cc:460] Webserver started at http://127.3.98.129:44529/ using document root <none> and password file <none>
I20260806 00:53:29.234648 11989 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:29.234719 11989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:29.234879 11989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:29.235970 11989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "1ad9d673898647c3b6365e895eb1d9a0"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "3bbf508c538ba842d1c415d270c118b4"
server_key_iv: "5d381ede0f57d135ef62e0143a1283bd"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.236518 11989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "1ad9d673898647c3b6365e895eb1d9a0"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "3bbf508c538ba842d1c415d270c118b4"
server_key_iv: "5d381ede0f57d135ef62e0143a1283bd"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.237934 11989 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:29.238675 12007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.238853 11989 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:29.238957 11989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "1ad9d673898647c3b6365e895eb1d9a0"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "3bbf508c538ba842d1c415d270c118b4"
server_key_iv: "5d381ede0f57d135ef62e0143a1283bd"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.239041 11989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:29.259605 11989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:29.262298 11989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:29.262495 11989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:29.262766 11989 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:29.263332 11989 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:29.263440 11989 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.263480 11989 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:29.263512 11989 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.270100 11989 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:40359
I20260806 00:53:29.270195 12165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:40359 every 8 connection(s)
I20260806 00:53:29.270551 11989 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
I20260806 00:53:29.279469 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 11989
I20260806 00:53:29.279588 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:29.279775 3466 external_mini_cluster.cc:1428] Setting key 11957aa679a18268fbee3ff85aeb329e
I20260806 00:53:29.281273 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.271465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:40319 (local address 127.3.98.190:35873)
0806 00:53:29.271554 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:29.271557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:29.271732 (+ 175us) server_negotiation.cc:407] Connection header received
0806 00:53:29.272318 (+ 586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:29.272319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:29.272332 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:29.272385 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:29.273512 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.274113 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.275347 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.275593 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.275704 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.278004 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:29.278005 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:29.278006 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:29.278013 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:29.279411 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.279891 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.279892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.279893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.279987 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.280395 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.280396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.280396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.280599 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:29.280690 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:29.281112 (+ 422us) server_negotiation.cc:299] Negotiation successful
0806 00:53:29.281202 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 00:53:29.281567 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.271360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.129:40319)
0806 00:53:29.271586 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:29.271637 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:29.272202 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:29.272544 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:29.272548 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:29.273159 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:29.273388 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.273393 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.274208 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.274209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.275244 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.275247 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.275718 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.275719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.275852 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.276331 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:29.276340 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:29.277857 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:29.279507 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.279514 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.279516 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.279805 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.280145 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.280147 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.280148 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.280304 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.280737 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:29.280745 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:29.280934 (+ 189us) client_negotiation.cc:769] Sending connection context
0806 00:53:29.281059 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 00:53:29.281269 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":114,"threads_started":1}
I20260806 00:53:29.282147 12166 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35873
I20260806 00:53:29.282250 12166 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:29.282552 12166 heartbeater.cc:511] Master 127.3.98.190:35873 requested a full tablet report, sending...
I20260806 00:53:29.283205 11897 ts_manager.cc:194] Registered new tserver with Master: 1ad9d673898647c3b6365e895eb1d9a0 (127.3.98.129:40359)
I20260806 00:53:29.283834 11897 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:40319
WARNING: no policy specified for oryx/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab.
Entry for principal oryx/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab.
I20260806 00:53:29.311129 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35873
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab
--principal=oryx/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:29.396445 12172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:29.396731 12172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:29.396756 12172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:29.397922 12172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:29.397965 12172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:29.397992 12172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:29.399457 12172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab
--principal=oryx/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:29.399712 12172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:29.399981 12172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:29.405254 12179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:29.405441 12172 server_base.cc:1034] running on GCE node
W20260806 00:53:29.405244 12178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:29.405251 12181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:29.405812 12172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:29.406139 12172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:29.407320 12172 hybrid_clock.cc:648] HybridClock initialized: now 1785977609407302 us; error 55 us; skew 500 ppm
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:29.409973 12172 init.cc:377] Logged in from keytab as oryx/127.3.98.130@KRBTEST.COM (short username oryx)
I20260806 00:53:29.410427 12172 webserver.cc:460] Webserver started at http://127.3.98.130:39541/ using document root <none> and password file <none>
I20260806 00:53:29.410673 12172 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:29.410745 12172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:29.410903 12172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:29.412050 12172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "19c13f490efb412195a794a3feb8fb41"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "3028cb237ce4e8280ed15895eeae2828"
server_key_iv: "b9eb24323af3856a598e2db9d9190c57"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.412429 12172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "19c13f490efb412195a794a3feb8fb41"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "3028cb237ce4e8280ed15895eeae2828"
server_key_iv: "b9eb24323af3856a598e2db9d9190c57"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.414031 12172 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:29.414814 12188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.414994 12172 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:29.415098 12172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "19c13f490efb412195a794a3feb8fb41"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "3028cb237ce4e8280ed15895eeae2828"
server_key_iv: "b9eb24323af3856a598e2db9d9190c57"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.415181 12172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:29.432298 12172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:29.434302 12172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:29.434478 12172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:29.434731 12172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:29.435058 12172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:29.435127 12172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.435169 12172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:29.435194 12172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.441165 12172 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:34691
I20260806 00:53:29.441215 12339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:34691 every 8 connection(s)
I20260806 00:53:29.441538 12172 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:29.447726 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 12172
I20260806 00:53:29.447841 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:29.448060 3466 external_mini_cluster.cc:1428] Setting key 1a02e10956cec20224fb72bfc4840202
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
I20260806 00:53:29.451695 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.442323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:59287 (local address 127.3.98.190:35873)
0806 00:53:29.442376 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:29.442379 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:29.442604 (+ 225us) server_negotiation.cc:407] Connection header received
0806 00:53:29.443152 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:29.443153 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:29.443163 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:29.443218 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:29.444239 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.444824 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.445961 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.446190 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.446259 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.448834 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:29.448835 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:29.448836 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:29.448844 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:29.450233 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.450659 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.450660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.450661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.450726 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.451001 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.451002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.451002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.451127 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:29.451203 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:29.451501 (+ 298us) server_negotiation.cc:299] Negotiation successful
0806 00:53:29.451601 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 00:53:29.451900 12343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.442305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.130:59287)
0806 00:53:29.442479 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:29.442516 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:29.443052 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:29.443295 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:29.443298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:29.443884 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:29.444143 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.444148 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.444905 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.444906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.445845 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.445848 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.446277 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.446277 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.446385 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.446965 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:29.446974 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:29.448720 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:29.450325 (+ 1605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.450333 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.450336 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.450578 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.450799 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.450799 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.450800 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.450921 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.451204 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:29.451213 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:29.451361 (+ 148us) client_negotiation.cc:769] Sending connection context
0806 00:53:29.451475 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 00:53:29.451651 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260806 00:53:29.452555 12340 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35873
I20260806 00:53:29.452693 12340 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:29.452891 12340 heartbeater.cc:511] Master 127.3.98.190:35873 requested a full tablet report, sending...
I20260806 00:53:29.453393 11897 ts_manager.cc:194] Registered new tserver with Master: 19c13f490efb412195a794a3feb8fb41 (127.3.98.130:34691)
I20260806 00:53:29.453975 11897 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:59287
WARNING: no policy specified for oryx/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab.
Entry for principal oryx/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab.
I20260806 00:53:29.476176 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35873
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab
--principal=oryx/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:29.561391 12349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:29.561607 12349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:29.561630 12349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:29.562752 12349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:29.562793 12349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:29.562819 12349 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:29.564194 12349 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab
--principal=oryx/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:29.564396 12349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:29.564656 12349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:29.569993 12355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:29.570133 12349 server_base.cc:1034] running on GCE node
W20260806 00:53:29.569993 12357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:29.570209 12354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:29.570451 12349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:29.570713 12349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:29.571882 12349 hybrid_clock.cc:648] HybridClock initialized: now 1785977609571882 us; error 40 us; skew 500 ppm
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:29.574769 12349 init.cc:377] Logged in from keytab as oryx/127.3.98.131@KRBTEST.COM (short username oryx)
I20260806 00:53:29.575286 12349 webserver.cc:460] Webserver started at http://127.3.98.131:36545/ using document root <none> and password file <none>
I20260806 00:53:29.575579 12349 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:29.575645 12349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:29.575748 12349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:29.576922 12349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "fc3e44d75413441683e21e65eb13473f"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "528156196368fdb78e8fda351e7be52d"
server_key_iv: "12df806da3f18f5e467f2825e966e143"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.577240 12349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "fc3e44d75413441683e21e65eb13473f"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "528156196368fdb78e8fda351e7be52d"
server_key_iv: "12df806da3f18f5e467f2825e966e143"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.578562 12349 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:53:29.579349 12367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.579566 12349 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:29.579679 12349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "fc3e44d75413441683e21e65eb13473f"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "528156196368fdb78e8fda351e7be52d"
server_key_iv: "12df806da3f18f5e467f2825e966e143"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.579756 12349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:29.598014 12349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:29.600386 12349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:29.600625 12349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:29.600888 12349 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:29.601212 12349 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:29.601266 12349 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.601307 12349 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:29.601336 12349 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.608071 12349 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:43081
I20260806 00:53:29.608110 12511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:43081 every 8 connection(s)
I20260806 00:53:29.608474 12349 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:29.611690 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 12349
I20260806 00:53:29.611770 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:29.612017 3466 external_mini_cluster.cc:1428] Setting key 78ab7c334942d79da4a5f01f3451cf07
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
I20260806 00:53:29.618743 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.609446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:59479 (local address 127.3.98.190:35873)
0806 00:53:29.609538 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:29.609541 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:29.609750 (+ 209us) server_negotiation.cc:407] Connection header received
0806 00:53:29.610239 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:29.610240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:29.610251 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:29.610312 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:29.611319 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.611894 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.613405 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.613604 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.613680 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.615910 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:29.615912 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:29.615912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:29.615921 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:29.617467 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.617888 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.617890 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.617890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.617961 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.618208 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.618209 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.618209 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.618322 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:29.618396 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:29.618612 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 00:53:29.618678 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 00:53:29.618969 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.609387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.131:59479)
0806 00:53:29.609610 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:29.609653 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:29.610154 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:29.610384 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:29.610388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:29.611016 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:29.611229 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.611234 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.611993 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.611995 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.613278 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.613282 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.613690 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.613691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.613794 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.614327 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:29.614336 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:29.615809 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:29.617537 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.617543 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.617545 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.617800 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.618042 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.618043 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.618043 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.618148 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.618378 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:29.618383 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:29.618495 (+ 112us) client_negotiation.cc:769] Sending connection context
0806 00:53:29.618590 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 00:53:29.618710 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":95,"threads_started":1}
I20260806 00:53:29.619517 12512 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35873
I20260806 00:53:29.619629 12512 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:29.619843 12512 heartbeater.cc:511] Master 127.3.98.190:35873 requested a full tablet report, sending...
I20260806 00:53:29.620281 11897 ts_manager.cc:194] Registered new tserver with Master: fc3e44d75413441683e21e65eb13473f (127.3.98.131:43081)
I20260806 00:53:29.620718 11897 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:59479
I20260806 00:53:29.623721 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.3.98.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.98.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.98.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.189.keytab.
Entry for principal oryx/127.3.98.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.189.keytab.
I20260806 00:53:29.652153 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.189:46075
--webserver_interface=127.3.98.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.189.keytab
--principal=oryx/127.3.98.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:35873,127.3.98.189:46075
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:29.737375 12521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:29.737598 12521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:29.737622 12521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:29.738924 12521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:29.738969 12521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:29.738984 12521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:29.738997 12521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:29.739032 12521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:29.740604 12521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:35873,127.3.98.189:46075
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.189.keytab
--principal=oryx/127.3.98.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.189:46075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.3.98.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
W20260806 00:53:29.740737 12521 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.3.98.190:35873,127.3.98.189:46075'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 00:53:29.740885 12521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:29.741132 12521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:29.746461 12527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:29.746492 12533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:29.746461 12529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:29.746632 12521 server_base.cc:1034] running on GCE node
I20260806 00:53:29.746939 12521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:29.747241 12521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:29.748383 12521 hybrid_clock.cc:648] HybridClock initialized: now 1785977609748363 us; error 41 us; skew 500 ppm
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:29.751032 12521 init.cc:377] Logged in from keytab as oryx/127.3.98.189@KRBTEST.COM (short username oryx)
I20260806 00:53:29.751459 12521 webserver.cc:460] Webserver started at http://127.3.98.189:39423/ using document root <none> and password file <none>
I20260806 00:53:29.751689 12521 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:29.751758 12521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:29.751915 12521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:29.753073 12521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/data/instance:
uuid: "88f120ad3cc24e3091de960923585ba1"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "d7d6c47311c3f5b7b2ba240787b1da3a"
server_key_iv: "eb7c6691c5b532bc0607112e7472b2dd"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.753448 12521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/wal/instance:
uuid: "88f120ad3cc24e3091de960923585ba1"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "d7d6c47311c3f5b7b2ba240787b1da3a"
server_key_iv: "eb7c6691c5b532bc0607112e7472b2dd"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.754932 12521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:53:29.755663 12543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.755832 12521 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:29.755931 12521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/wal
uuid: "88f120ad3cc24e3091de960923585ba1"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "d7d6c47311c3f5b7b2ba240787b1da3a"
server_key_iv: "eb7c6691c5b532bc0607112e7472b2dd"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.756019 12521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:29.768939 12521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:29.770861 12521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:29.771036 12521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:29.775681 12521 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.189:46075
I20260806 00:53:29.775760 12614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.189:46075 every 8 connection(s)
I20260806 00:53:29.776126 12521 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/data/info.pb
I20260806 00:53:29.777211 12615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:29.778666 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 12521
I20260806 00:53:29.778808 12615 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.189@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.98.189@KRBTEST.COM
I20260806 00:53:29.789111 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.779625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45040 (local address 127.3.98.190:35873)
0806 00:53:29.779693 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:29.779696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:29.779865 (+ 169us) server_negotiation.cc:407] Connection header received
0806 00:53:29.780275 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:29.780277 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:29.780291 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:29.780353 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:29.780965 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.781489 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.782433 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.782634 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.782715 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.785364 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:29.785365 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:29.785366 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:29.785374 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:29.787182 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.787674 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.787675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.787676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.787740 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.788291 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.788292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.788292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.788561 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:29.788636 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:29.788907 (+ 271us) server_negotiation.cc:299] Negotiation successful
0806 00:53:29.789013 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 00:53:29.789237 12620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.779382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47994 (local address 127.3.98.189:46075)
0806 00:53:29.779701 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:29.779712 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:29.779740 (+ 28us) server_negotiation.cc:407] Connection header received
0806 00:53:29.780164 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:29.780171 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:29.780190 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:29.780305 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:29.781005 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.781904 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.782712 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.783033 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.783144 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.785935 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:29.785942 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:29.785943 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:29.785949 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:29.787735 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.788054 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.788057 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.788057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.788147 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.788364 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.788365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.788365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.788655 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:29.788814 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:29.788891 (+ 77us) server_negotiation.cc:299] Negotiation successful
0806 00:53:29.789014 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":160,"threads_started":1}
I20260806 00:53:29.789469 12622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.779562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:45040)
0806 00:53:29.779752 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:29.779785 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:29.780179 (+ 394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:29.780373 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:29.780376 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:29.780715 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:29.780870 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.780874 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.781596 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.781598 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.782311 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.782313 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.782754 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.782756 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.782884 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.783446 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:29.783455 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:29.785264 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:29.787269 (+ 2005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.787275 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.787277 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.787595 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.788058 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.788059 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.788059 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.788225 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.788639 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:29.788645 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:29.788741 (+ 96us) client_negotiation.cc:769] Sending connection context
0806 00:53:29.788851 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 00:53:29.789141 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":120,"thread_start_us":84,"threads_started":1}
I20260806 00:53:29.790361 12615 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.189@KRBTEST.COM for oryx/127.3.98.189@KRBTEST.COM
I20260806 00:53:29.796458 12622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.790624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:46075 (local address 127.0.0.1:47998)
0806 00:53:29.790673 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:29.790683 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:29.790724 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:29.790844 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:29.790845 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:29.790988 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:29.791016 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.791017 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.791631 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.791632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.792100 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.792101 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.792525 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.792526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.792604 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.793015 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:29.793020 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:29.794135 (+ 1115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:29.795653 (+ 1518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.795654 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.795654 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.795817 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.795991 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.795991 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.795991 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.796041 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.796241 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:29.796241 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:29.796274 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 00:53:29.796324 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 00:53:29.796400 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 00:53:29.796653 12620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.790680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47998 (local address 127.3.98.189:46075)
0806 00:53:29.790714 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:29.790716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:29.790725 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:53:29.790780 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:29.790781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:29.790789 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:29.790841 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:29.791101 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.791549 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.792229 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.792434 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.792529 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.794228 (+ 1699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:29.794229 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:29.794230 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:29.794236 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:29.795577 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.795881 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.795882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.795883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.795932 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.796097 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.796098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.796098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.796188 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:29.796235 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:29.796357 (+ 122us) server_negotiation.cc:299] Negotiation successful
0806 00:53:29.796471 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":19}
I20260806 00:53:29.797894 12615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: Bootstrap starting.
I20260806 00:53:29.798743 12615 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:29.799036 12615 log.cc:824] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:29.799801 12615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: No bootstrap required, opened a new log
I20260806 00:53:29.801290 12615 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } }
I20260806 00:53:29.801445 12615 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:29.801494 12615 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88f120ad3cc24e3091de960923585ba1, State: Initialized, Role: FOLLOWER
I20260806 00:53:29.801681 12615 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } }
I20260806 00:53:29.801964 12624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } } }
I20260806 00:53:29.802017 12615 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:29.802063 12624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 00:53:29.803818 12637 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 00:53:29.804033 12637 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:53:29.805768 12521 master_runner.cc:428] Detected that this master 88f120ad3cc24e3091de960923585ba1 is joining an existing cluster
I20260806 00:53:29.805850 12521 master_runner.cc:432] Initiating AddMaster RPC to add 127.3.98.189:46075
I20260806 00:53:29.814229 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.807192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45050 (local address 127.3.98.190:35873)
0806 00:53:29.807249 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:29.807251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:29.807314 (+ 63us) server_negotiation.cc:407] Connection header received
0806 00:53:29.807423 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:29.807424 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:29.807436 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:29.807495 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:29.807903 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.808681 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.809457 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.809738 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.809799 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.811078 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:29.811080 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:29.811081 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:29.811089 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:29.812853 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.813307 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.813309 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.813309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.813379 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.813601 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.813603 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.813603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.813732 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:29.813797 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:29.814007 (+ 210us) server_negotiation.cc:299] Negotiation successful
0806 00:53:29.814124 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 00:53:29.814415 12620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.806854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48000 (local address 127.3.98.189:46075)
0806 00:53:29.806899 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:29.806901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:29.807284 (+ 383us) server_negotiation.cc:407] Connection header received
0806 00:53:29.807353 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:29.807353 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:29.807363 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:29.807413 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:29.807816 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.808579 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.809600 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.809878 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.809940 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.811443 (+ 1503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:29.811445 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:29.811445 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:29.811452 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:29.813121 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.813512 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.813513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.813513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.813560 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.813787 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.813788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.813788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.813908 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:29.813975 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:29.814137 (+ 162us) server_negotiation.cc:299] Negotiation successful
0806 00:53:29.814267 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":19}
I20260806 00:53:29.814327 12645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.806818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:46075 (local address 127.0.0.1:48000)
0806 00:53:29.807219 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:29.807230 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:29.807296 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:29.807454 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:29.807454 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:29.807671 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:29.807734 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.807736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.808666 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.808667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.809512 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.809515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.809976 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.809977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.810052 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.810924 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:29.810929 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:29.811339 (+ 410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:29.813205 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.813206 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.813206 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.813435 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.813639 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.813640 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.813641 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.813713 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.813978 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:29.813979 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:29.814024 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 00:53:29.814100 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 00:53:29.814211 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":98,"threads_started":1}
I20260806 00:53:29.814615 12647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.807120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:45050)
0806 00:53:29.807254 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:29.807264 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:29.807349 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:29.807515 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:29.807515 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:29.807769 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:29.807831 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.807833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.808781 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.808782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.809369 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.809371 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.809868 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.809869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.809930 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.810513 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:29.810518 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:29.810969 (+ 451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:29.812948 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.812949 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.812949 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.813237 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.813448 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.813449 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.813450 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.813517 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.813846 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:29.813847 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:29.813889 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 00:53:29.814357 (+ 468us) client_negotiation.cc:240] Negotiation successful
0806 00:53:29.814477 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":77,"threads_started":1}
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.190@KRBTEST.COM for oryx/127.3.98.189@KRBTEST.COM
I20260806 00:53:29.824947 12648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.817245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:46075 (local address 127.0.0.1:48006)
0806 00:53:29.817408 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:29.817474 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:29.817551 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:29.817693 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:29.817695 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:29.818051 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:29.818110 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.818112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.818838 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.818840 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.819822 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.819824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.820152 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.820153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.820238 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.820738 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:29.820744 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:29.822266 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:29.823839 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.823847 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.823850 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.824088 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.824318 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.824318 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.824319 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.824378 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.824659 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:29.824666 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:29.824711 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 00:53:29.824783 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 00:53:29.824875 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":79,"threads_started":1}
I20260806 00:53:29.825013 12620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.817316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48006 (local address 127.3.98.189:46075)
0806 00:53:29.817357 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:29.817359 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:29.817533 (+ 174us) server_negotiation.cc:407] Connection header received
0806 00:53:29.817627 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:29.817628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:29.817636 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:29.817686 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:29.818185 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.818768 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.819906 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.820079 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.820129 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.822357 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:29.822358 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:29.822358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:29.822366 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:29.823733 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.824176 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.824177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.824178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.824243 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.824443 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.824444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.824445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.824591 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:29.824662 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:29.824832 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 00:53:29.824910 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:53:29.825601 11897 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.3.98.189:46075: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "88f120ad3cc24e3091de960923585ba1"
member_type: NON_VOTER
last_known_addr {
host: "127.3.98.189"
port: 46075
}
attrs {
promote: true
}
}
dest_uuid: "7bef2a3e691043d78c4315565b15c55c"
cas_config_opid_index: -1
I20260806 00:53:29.826014 11897 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true } }
I20260806 00:53:29.826572 12651 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 88f120ad3cc24e3091de960923585ba1 (127.3.98.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true } } }
I20260806 00:53:29.826864 12578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:29.827687 12578 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 FOLLOWER]: Refusing update from remote peer 7bef2a3e691043d78c4315565b15c55c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 00:53:29.827718 12651 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.3.98.189:46075
I20260806 00:53:29.827958 12649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true } } }
I20260806 00:53:29.828022 12521 master.cc:537] Master@127.3.98.189:46075 shutting down...
I20260806 00:53:29.828154 12649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:29.828240 12651 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 00:53:29.829172 11880 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260806 00:53:29.829759 11880 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c -> Peer 88f120ad3cc24e3091de960923585ba1 (127.3.98.189:46075): Couldn't send request to peer 88f120ad3cc24e3091de960923585ba1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 00:53:29.830978 12521 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:29.831092 12521 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:29.831153 12521 tablet_replica.cc:330] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: stopping tablet replica
I20260806 00:53:29.843757 12521 master.cc:552] Master@127.3.98.189:46075 shutdown complete.
I20260806 00:53:29.843832 12521 master_runner.cc:305] Clearing existing system tablet
I20260806 00:53:29.843961 12521 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:29.844029 12521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:29.844698 12521 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.002s
I20260806 00:53:29.845520 12657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.845681 12521 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:29.845757 12521 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:29.845785 12521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/wal
uuid: "88f120ad3cc24e3091de960923585ba1"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "d7d6c47311c3f5b7b2ba240787b1da3a"
server_key_iv: "eb7c6691c5b532bc0607112e7472b2dd"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.846741 12521 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:29.848701 12521 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 00:53:29.848780 12521 log.cc:1196] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 00:53:29.848999 12521 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: Deleting consensus metadata
I20260806 00:53:29.849126 12521 master_runner.cc:315] Copying system tablet from 127.3.98.190:35873
I20260806 00:53:29.849757 12521 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: tablet copy: Beginning tablet copy session from remote peer at address 127.3.98.190:35873
I20260806 00:53:29.856369 12663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.850144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:45056)
0806 00:53:29.850277 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:29.850288 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:29.850360 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:29.850508 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:29.850509 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:29.850687 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:29.850744 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.850746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.851705 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.851706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.852261 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:29.852262 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.852775 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.852776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:29.852828 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.853334 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:29.853342 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:29.853658 (+ 316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:29.855394 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.855394 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.855395 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.855577 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.855786 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:29.855786 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:29.855787 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:29.855839 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:29.856112 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:29.856113 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:29.856155 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 00:53:29.856220 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 00:53:29.856297 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":91,"threads_started":1}
I20260806 00:53:29.856463 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.850213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45056 (local address 127.3.98.190:35873)
0806 00:53:29.850266 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:29.850269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:29.850364 (+ 95us) server_negotiation.cc:407] Connection header received
0806 00:53:29.850404 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:29.850405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:29.850417 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:29.850486 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:29.850823 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.851619 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.852357 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.852700 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.852776 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.853753 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:29.853755 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:29.853755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:29.853763 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:29.855309 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.855651 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.855652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.855653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.855717 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.855901 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.855902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.855902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.856044 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:29.856122 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:29.856274 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 00:53:29.856369 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 00:53:29.856980 11929 tablet_copy_service.cc:140] P 7bef2a3e691043d78c4315565b15c55c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 88f120ad3cc24e3091de960923585ba1 ({username='oryx', principal='oryx/127.3.98.189@KRBTEST.COM'} at 127.0.0.1:45056)
I20260806 00:53:29.857115 11929 tablet_copy_service.cc:161] P 7bef2a3e691043d78c4315565b15c55c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 88f120ad3cc24e3091de960923585ba1 at {username='oryx', principal='oryx/127.3.98.189@KRBTEST.COM'} at 127.0.0.1:45056: session id = 88f120ad3cc24e3091de960923585ba1-00000000000000000000000000000000
I20260806 00:53:29.857865 11929 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 00:53:29.858526 12521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 00:53:29.859710 12521 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: tablet copy: Starting download of 0 data blocks...
I20260806 00:53:29.859913 12521 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: tablet copy: Starting download of 1 WAL segments...
I20260806 00:53:29.860934 12521 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 00:53:29.861804 11929 tablet_copy_service.cc:342] P 7bef2a3e691043d78c4315565b15c55c: Request end of tablet copy session 88f120ad3cc24e3091de960923585ba1-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.3.98.189@KRBTEST.COM'} at 127.0.0.1:45056
I20260806 00:53:29.861869 11929 tablet_copy_service.cc:433] P 7bef2a3e691043d78c4315565b15c55c: ending tablet copy session 88f120ad3cc24e3091de960923585ba1-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 88f120ad3cc24e3091de960923585ba1
I20260806 00:53:29.865192 12521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:29.866372 12664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:29.866480 12668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:29.866408 12665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:29.866847 12521 server_base.cc:1034] running on GCE node
I20260806 00:53:29.866945 12521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:29.867074 12521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:29.868206 12521 hybrid_clock.cc:648] HybridClock initialized: now 1785977609868197 us; error 23 us; skew 500 ppm
Aug 06 00:53:29 dist-test-slave-44d2 krb5kdc[11841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:29.869549 12521 init.cc:377] Logged in from keytab as oryx/127.3.98.189@KRBTEST.COM (short username oryx)
I20260806 00:53:29.869839 12521 webserver.cc:460] Webserver started at http://127.3.98.189:34573/ using document root <none> and password file <none>
I20260806 00:53:29.869961 12521 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:29.870018 12521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:29.870637 12521 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:29.871168 12676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.871316 12521 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:29.871366 12521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/wal
uuid: "88f120ad3cc24e3091de960923585ba1"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "d7d6c47311c3f5b7b2ba240787b1da3a"
server_key_iv: "eb7c6691c5b532bc0607112e7472b2dd"
server_key_version: "encryptionkey@0"
I20260806 00:53:29.871417 12521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:29.897735 12521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:29.899638 12521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:29.903281 12521 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.189:46075
I20260806 00:53:29.903302 12745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.189:46075 every 8 connection(s)
I20260806 00:53:29.903663 12521 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-1/data/info.pb
I20260806 00:53:29.904808 12749 sys_catalog.cc:263] Verifying existing consensus state
I20260806 00:53:29.905551 12749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: Bootstrap starting.
I20260806 00:53:29.909147 12749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 00:53:29.909472 12749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: Bootstrap complete.
I20260806 00:53:29.909735 12749 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true } }
I20260806 00:53:29.909845 12749 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 88f120ad3cc24e3091de960923585ba1, State: Initialized, Role: LEARNER
I20260806 00:53:29.909893 12749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true } }
I20260806 00:53:29.910105 12749 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:29.910140 12753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true } } }
I20260806 00:53:29.910279 12753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: This master's current role is: LEARNER
I20260806 00:53:29.912245 12771 catalog_manager.cc:1259] Loaded cluster ID: 1f988396248f42d78eb9c509cb2ac5c1
I20260806 00:53:29.912304 12771 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: loading cluster ID for follower catalog manager: success
I20260806 00:53:29.913156 12771 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: acquiring CA information for follower catalog manager: success
I20260806 00:53:29.913441 12771 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 00:53:29.948808 12772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:29.941832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48020 (local address 127.3.98.189:46075)
0806 00:53:29.941973 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:29.941975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:29.941989 (+ 14us) server_negotiation.cc:407] Connection header received
0806 00:53:29.942016 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:29.942017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:29.942027 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:29.942128 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:29.942864 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.943525 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.944345 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:29.944620 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:29.944701 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:29.946029 (+ 1328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:29.946031 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:29.946031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:29.946039 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:29.947537 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.947893 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.947894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.947894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.947962 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:29.948182 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:29.948183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:29.948183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:29.948303 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:29.948414 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:29.948565 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 00:53:29.948660 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":84,"threads_started":1}
WARNING: no policy specified for oryx/127.3.98.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.98.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.98.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.188.keytab.
Entry for principal oryx/127.3.98.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.188.keytab.
I20260806 00:53:29.979534 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.188:42877
--webserver_interface=127.3.98.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.188.keytab
--principal=oryx/127.3.98.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:35873,127.3.98.189:46075,127.3.98.188:42877
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:30.065007 12776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:30.065210 12776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:30.065232 12776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:30.066391 12776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:30.066434 12776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:30.066454 12776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:30.066468 12776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:30.066504 12776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:30.068053 12776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:35873,127.3.98.189:46075,127.3.98.188:42877
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.188.keytab
--principal=oryx/127.3.98.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.188:42877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.3.98.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:30.068310 12776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:30.068605 12776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:30.073478 12783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:30.073454 12785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:30.073459 12782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:30.073733 12776 server_base.cc:1034] running on GCE node
I20260806 00:53:30.073980 12776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:30.074326 12776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:30.075490 12776 hybrid_clock.cc:648] HybridClock initialized: now 1785977610075467 us; error 40 us; skew 500 ppm
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:30.078112 12776 init.cc:377] Logged in from keytab as oryx/127.3.98.188@KRBTEST.COM (short username oryx)
I20260806 00:53:30.078495 12776 webserver.cc:460] Webserver started at http://127.3.98.188:43595/ using document root <none> and password file <none>
I20260806 00:53:30.078685 12776 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:30.078727 12776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:30.078814 12776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:30.079896 12776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/data/instance:
uuid: "aeaa49fd09c9478a9b5b2a64107268f3"
format_stamp: "Formatted at 2026-08-06 00:53:30 on dist-test-slave-44d2"
server_key: "c7c41950ea617b1fd1d77ac94b2ca732"
server_key_iv: "02256fd75a8899d0902820f630d1ca8f"
server_key_version: "encryptionkey@0"
I20260806 00:53:30.080216 12776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/wal/instance:
uuid: "aeaa49fd09c9478a9b5b2a64107268f3"
format_stamp: "Formatted at 2026-08-06 00:53:30 on dist-test-slave-44d2"
server_key: "c7c41950ea617b1fd1d77ac94b2ca732"
server_key_iv: "02256fd75a8899d0902820f630d1ca8f"
server_key_version: "encryptionkey@0"
I20260806 00:53:30.081678 12776 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:53:30.082532 12794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.082739 12776 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:30.082837 12776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/wal
uuid: "aeaa49fd09c9478a9b5b2a64107268f3"
format_stamp: "Formatted at 2026-08-06 00:53:30 on dist-test-slave-44d2"
server_key: "c7c41950ea617b1fd1d77ac94b2ca732"
server_key_iv: "02256fd75a8899d0902820f630d1ca8f"
server_key_version: "encryptionkey@0"
I20260806 00:53:30.082913 12776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:30.097698 12776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:30.099889 12776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:30.100044 12776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:30.104686 12776 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.188:42877
I20260806 00:53:30.104729 12867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.188:42877 every 8 connection(s)
I20260806 00:53:30.105077 12776 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/data/info.pb
I20260806 00:53:30.105594 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 12776
I20260806 00:53:30.106478 12868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:30.108649 12868 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977608, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.98.188@KRBTEST.COM
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.188@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
I20260806 00:53:30.116278 12871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.106281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39616 (local address 127.3.98.188:42877)
0806 00:53:30.106478 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.106486 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.106512 (+ 26us) server_negotiation.cc:407] Connection header received
0806 00:53:30.107001 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.107008 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.107054 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.107178 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.108020 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.109110 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.110087 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.110514 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.110703 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.113185 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.113193 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.113193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.113200 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.114794 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.115158 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.115162 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.115162 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.115244 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.115466 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.115467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.115467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.115688 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.115860 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.115957 (+ 97us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.116123 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":100,"threads_started":1}
I20260806 00:53:30.117280 12872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.109318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:45072)
0806 00:53:30.109467 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.109505 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.109575 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.109712 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.109713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.109953 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.110054 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.110057 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.110866 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.110868 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.111559 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.111562 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.112018 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.112019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.112091 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.112612 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.112620 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.114286 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.115990 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.115997 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.115999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.116288 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.116579 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.116580 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.116580 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.116645 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.117017 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.117023 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.117063 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.117133 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.117213 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":94,"threads_started":1}
I20260806 00:53:30.117333 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.109442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45072 (local address 127.3.98.190:35873)
0806 00:53:30.109487 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.109489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.109586 (+ 97us) server_negotiation.cc:407] Connection header received
0806 00:53:30.109619 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.109620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.109631 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.109699 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.110188 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.110748 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.111656 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.111922 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.111997 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.114395 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.114396 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.114396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.114404 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.115884 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.116382 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.116383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.116383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.116446 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.116725 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.116727 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.116727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.116869 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.116948 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.117205 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.117271 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 00:53:30.117806 12868 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.188@KRBTEST.COM for oryx/127.3.98.189@KRBTEST.COM
I20260806 00:53:30.123945 12772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.118143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48036 (local address 127.3.98.189:46075)
0806 00:53:30.118209 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.118210 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.118219 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:53:30.118245 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.118246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.118264 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.118308 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.118528 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.119014 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.119732 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.119927 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.119984 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.121729 (+ 1745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.121730 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.121730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.121737 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.122956 (+ 1219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.123302 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.123303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.123303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.123353 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.123534 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.123535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.123535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.123645 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.123695 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.123816 (+ 121us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.123883 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 00:53:30.124078 12872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.118048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:46075 (local address 127.0.0.1:48036)
0806 00:53:30.118127 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.118137 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.118183 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.118309 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.118310 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.118419 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.118469 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.118470 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.119086 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.119087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.119657 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.119660 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.120018 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.120019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.120076 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.120566 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.120571 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.121650 (+ 1079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.123047 (+ 1397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.123048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.123049 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.123229 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.123419 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.123420 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.123420 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.123478 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.123702 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.123703 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.123737 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.123798 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.123940 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 00:53:30.124641 12868 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.188@KRBTEST.COM for oryx/127.3.98.188@KRBTEST.COM
I20260806 00:53:30.131197 12871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.124989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39618 (local address 127.3.98.188:42877)
0806 00:53:30.125040 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.125042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.125062 (+ 20us) server_negotiation.cc:407] Connection header received
0806 00:53:30.125098 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.125099 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.125106 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.125145 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.125363 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.125808 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.126534 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.126728 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.126781 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.128945 (+ 2164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.128946 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.128947 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.128953 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.130192 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.130538 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.130539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.130539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.130591 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.130765 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.130765 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.130765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.130864 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.130914 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.131032 (+ 118us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.131128 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 00:53:30.131326 12872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.124879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:42877 (local address 127.0.0.1:39618)
0806 00:53:30.124964 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.124977 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.125034 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.125150 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.125150 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.125274 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.125305 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.125306 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.125926 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.125927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.126460 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.126461 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.126795 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.126796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.126835 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.127518 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.127524 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.128851 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.130288 (+ 1437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.130289 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.130289 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.130471 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.130652 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.130652 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.130653 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.130709 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.130919 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.130920 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.130955 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.131016 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.131176 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"mutex_wait_us":74}
I20260806 00:53:30.133067 12868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: Bootstrap starting.
I20260806 00:53:30.133977 12868 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:30.134354 12868 log.cc:824] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:30.135200 12868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: No bootstrap required, opened a new log
I20260806 00:53:30.136806 12868 raft_consensus.cc:348] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } }
I20260806 00:53:30.136976 12868 raft_consensus.cc:374] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:30.137028 12868 raft_consensus.cc:729] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeaa49fd09c9478a9b5b2a64107268f3, State: Initialized, Role: FOLLOWER
I20260806 00:53:30.137198 12868 consensus_queue.cc:260] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } }
I20260806 00:53:30.137485 12875 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } } }
I20260806 00:53:30.137557 12868 sys_catalog.cc:564] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:30.137619 12875 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 00:53:30.139423 12887 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 00:53:30.139488 12887 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:53:30.142277 12776 master_runner.cc:428] Detected that this master aeaa49fd09c9478a9b5b2a64107268f3 is joining an existing cluster
I20260806 00:53:30.142335 12776 master_runner.cc:432] Initiating AddMaster RPC to add 127.3.98.188:42877
I20260806 00:53:30.151412 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.143957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45076 (local address 127.3.98.190:35873)
0806 00:53:30.143999 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.144002 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.144531 (+ 529us) server_negotiation.cc:407] Connection header received
0806 00:53:30.144630 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.144631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.144642 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.144696 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.145113 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.145866 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.146928 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.147232 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.147275 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.148734 (+ 1459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.148735 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.148736 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.148742 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.150296 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.150699 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.150700 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.150700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.150756 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.150956 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.150956 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.150956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.151056 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.151118 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.151285 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.151347 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:53:30.151471 12896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.143991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:45076)
0806 00:53:30.144452 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.144462 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.144559 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.144700 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.144700 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.144939 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.145013 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.145015 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.145977 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.145978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.146820 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.146823 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.147702 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.147703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.147770 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.148169 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.148174 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.148638 (+ 464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.150393 (+ 1755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.150394 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.150395 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.150617 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.150820 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.150821 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.150821 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.150893 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.151131 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.151132 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.151177 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.151255 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.151360 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":126,"threads_started":1}
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.190@KRBTEST.COM for oryx/127.3.98.188@KRBTEST.COM
I20260806 00:53:30.163878 12648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.153495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:42877 (local address 127.0.0.1:39642)
0806 00:53:30.153556 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.153566 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.153611 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.153849 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.153850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.154004 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.154038 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.154039 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.154686 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.154688 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.155191 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.155193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.155550 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.155552 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.155626 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.156053 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.156057 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.157456 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.162551 (+ 5095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.162552 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.162552 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.162784 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.163021 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.163021 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.163022 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.163159 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.163517 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.163518 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.163564 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.163632 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.163744 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 00:53:30.164562 12897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.153562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39642 (local address 127.3.98.188:42877)
0806 00:53:30.153725 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.153726 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.153732 (+ 6us) server_negotiation.cc:407] Connection header received
0806 00:53:30.153761 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.153762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.153769 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.153846 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.154120 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.154605 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.155274 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.155476 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.155551 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.157545 (+ 1994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.157546 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.157547 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.157554 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.162486 (+ 4932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.162881 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.162882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.162882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.162945 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.163249 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.163250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.163251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.163427 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.164298 (+ 871us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.164336 (+ 38us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.164425 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":95,"threads_started":1}
I20260806 00:53:30.164827 12894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.143626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:46075 (local address 127.0.0.1:48048)
0806 00:53:30.144088 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.144100 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.144192 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.144456 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.144456 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.144877 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.144939 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.144941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.145899 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.145900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.146751 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.146752 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.147250 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.147250 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.147318 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.160916 (+ 13598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.160920 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.161456 (+ 536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.163516 (+ 2060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.163517 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.163517 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.163880 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.164128 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.164128 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.164129 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.164188 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.164468 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.164469 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.164537 (+ 68us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.164603 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.164731 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"spinlock_wait_cycles":11136,"thread_start_us":269,"threads_started":1}
I20260806 00:53:30.164983 12871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.143679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39630 (local address 127.3.98.188:42877)
0806 00:53:30.143719 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.143721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.144268 (+ 547us) server_negotiation.cc:407] Connection header received
0806 00:53:30.144323 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.144324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.144335 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.144391 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.144863 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.145617 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.146743 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.147006 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.147042 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.161350 (+ 14308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.161351 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.161352 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.161357 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.163876 (+ 2519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.164234 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.164234 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.164235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.164279 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.164448 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.164448 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.164449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.164577 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.164618 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.164809 (+ 191us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.164884 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 00:53:30.165164 12772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.143791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48048 (local address 127.3.98.189:46075)
0806 00:53:30.143842 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.143844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.144160 (+ 316us) server_negotiation.cc:407] Connection header received
0806 00:53:30.144291 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.144291 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.144305 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.144335 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.145039 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.145778 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.146831 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.147136 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.147175 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.161550 (+ 14375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.161551 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.161552 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.161561 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.163434 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.163967 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.163968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.163969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.164039 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.164251 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.164252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.164252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.164382 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.164442 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.164942 (+ 500us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.165028 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 00:53:30.165531 12895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.143626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:42877 (local address 127.0.0.1:39630)
0806 00:53:30.144201 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.144209 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.144261 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.144410 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.144411 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.144680 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.144779 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.144782 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.145700 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.145700 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.146637 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.146640 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.147120 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.147121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.147173 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.147678 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.147682 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.161259 (+ 13577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.163967 (+ 2708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.163967 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.163968 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.164162 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.164339 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.164340 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.164340 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.164389 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.164657 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.164658 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.164689 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.165155 (+ 466us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.165358 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":2,"thread_start_us":290,"threads_started":1}
I20260806 00:53:30.165920 11897 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.3.98.188:42877: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3"
member_type: NON_VOTER
last_known_addr {
host: "127.3.98.188"
port: 42877
}
attrs {
promote: true
}
}
dest_uuid: "7bef2a3e691043d78c4315565b15c55c"
cas_config_opid_index: 5
I20260806 00:53:30.166213 11897 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } }
I20260806 00:53:30.166565 12651 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER aeaa49fd09c9478a9b5b2a64107268f3 (127.3.98.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } } }
I20260806 00:53:30.167301 12830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:30.167578 12651 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.3.98.188:42877
I20260806 00:53:30.167665 12651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } } }
I20260806 00:53:30.167728 12651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:30.168111 12776 master.cc:537] Master@127.3.98.188:42877 shutting down...
I20260806 00:53:30.168321 12830 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 FOLLOWER]: Refusing update from remote peer 7bef2a3e691043d78c4315565b15c55c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 00:53:30.168788 12649 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 00:53:30.169445 11879 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c -> Peer aeaa49fd09c9478a9b5b2a64107268f3 (127.3.98.188:42877): Couldn't send request to peer aeaa49fd09c9478a9b5b2a64107268f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 00:53:30.172326 12776 raft_consensus.cc:2229] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:30.172415 12776 raft_consensus.cc:2258] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:30.172459 12776 tablet_replica.cc:330] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: stopping tablet replica
I20260806 00:53:30.172969 12648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.167913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:46075 (local address 127.0.0.1:48064)
0806 00:53:30.168696 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.168708 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.168759 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.169071 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.169072 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.169074 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:30.169120 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.169121 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.170081 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.170082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.171386 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.171389 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.172631 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.172632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.172748 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.172775 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.172839 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.172885 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":762}
I20260806 00:53:30.172976 12772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.167989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48064 (local address 127.3.98.189:46075)
0806 00:53:30.168029 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.168031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.168895 (+ 864us) server_negotiation.cc:407] Connection header received
0806 00:53:30.168923 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.168924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.168950 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.169011 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:30.169198 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.169989 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.171607 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.172397 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.172463 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.172594 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.172858 (+ 264us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.172901 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:53:30.173421 12712 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 LEARNER]: Refusing update from remote peer 7bef2a3e691043d78c4315565b15c55c: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 00:53:30.173632 12649 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260806 00:53:30.174335 12712 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER aeaa49fd09c9478a9b5b2a64107268f3 (127.3.98.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } } }
W20260806 00:53:30.174770 12797 connection.cc:441] server connection from 127.0.0.1:39616 torn down before Call kudu.master.MasterService.ListTables from 127.0.0.1:39616 (request call id 38) could send its response
I20260806 00:53:30.175827 12753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } } }
I20260806 00:53:30.175931 12753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: This master's current role is: LEARNER
I20260806 00:53:30.175827 12900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bef2a3e691043d78c4315565b15c55c. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: NON_VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: true } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } } }
I20260806 00:53:30.176177 12900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: This master's current role is: LEARNER
I20260806 00:53:30.176424 12649 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c: attempting to promote NON_VOTER 88f120ad3cc24e3091de960923585ba1 to VOTER
I20260806 00:53:30.176692 12649 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } }
I20260806 00:53:30.177230 12648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.177093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:42877 (local address 127.0.0.1:39656)
0806 00:53:30.177152 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.177200 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:42877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 00:53:30.177289 12712 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 LEARNER]: Refusing update from remote peer 7bef2a3e691043d78c4315565b15c55c: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 00:53:30.177500 12649 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260806 00:53:30.177636 12648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.177554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:42877 (local address 127.0.0.1:39666)
0806 00:53:30.177591 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.177612 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:42877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260806 00:53:30.177693 11879 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c -> Peer aeaa49fd09c9478a9b5b2a64107268f3 (127.3.98.188:42877): Couldn't send request to peer aeaa49fd09c9478a9b5b2a64107268f3. Status: Network error: Client connection negotiation failed: client connection to 127.3.98.188:42877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 00:53:30.178257 12901 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 88f120ad3cc24e3091de960923585ba1 (127.3.98.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } } }
I20260806 00:53:30.178380 12712 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 88f120ad3cc24e3091de960923585ba1 (127.3.98.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } } }
I20260806 00:53:30.179152 12900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } } }
I20260806 00:53:30.179183 12901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } } }
I20260806 00:53:30.179240 12900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:53:30.179252 12901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:30.179313 12651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } } }
I20260806 00:53:30.179409 12651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:30.186524 12776 master.cc:552] Master@127.3.98.188:42877 shutdown complete.
I20260806 00:53:30.186594 12776 master_runner.cc:305] Clearing existing system tablet
I20260806 00:53:30.186735 12776 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:30.186808 12776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:30.187538 12776 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:30.188084 12905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.188277 12776 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:30.188349 12776 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 00:53:30.188374 12776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/wal
uuid: "aeaa49fd09c9478a9b5b2a64107268f3"
format_stamp: "Formatted at 2026-08-06 00:53:30 on dist-test-slave-44d2"
server_key: "c7c41950ea617b1fd1d77ac94b2ca732"
server_key_iv: "02256fd75a8899d0902820f630d1ca8f"
server_key_version: "encryptionkey@0"
I20260806 00:53:30.189230 12776 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:30.190754 12776 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 00:53:30.190826 12776 log.cc:1196] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 00:53:30.191080 12776 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: Deleting consensus metadata
I20260806 00:53:30.191211 12776 master_runner.cc:315] Copying system tablet from 127.3.98.190:35873
I20260806 00:53:30.191809 12776 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: tablet copy: Beginning tablet copy session from remote peer at address 127.3.98.190:35873
I20260806 00:53:30.198501 12914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.192119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:45090)
0806 00:53:30.192232 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.192242 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.192326 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.192472 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.192472 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.192712 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.192773 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.192775 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.193716 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.193717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.194261 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.194262 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.194716 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.194717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.194765 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.195356 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.195362 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.195684 (+ 322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.197443 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.197444 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.197445 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.197701 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.197915 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.197916 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.197916 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.197971 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.198242 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.198242 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.198279 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.198330 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.198411 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":73,"threads_started":1}
I20260806 00:53:30.198542 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.192187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45090 (local address 127.3.98.190:35873)
0806 00:53:30.192237 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.192239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.192307 (+ 68us) server_negotiation.cc:407] Connection header received
0806 00:53:30.192379 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.192380 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.192391 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.192464 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.192852 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.193630 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.194338 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.194637 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.194712 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.195775 (+ 1063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.195777 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.195778 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.195785 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.197354 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.197778 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.197779 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.197780 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.197846 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.198033 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.198034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.198035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.198175 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.198249 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.198371 (+ 122us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.198450 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 00:53:30.199117 11929 tablet_copy_service.cc:140] P 7bef2a3e691043d78c4315565b15c55c: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer aeaa49fd09c9478a9b5b2a64107268f3 ({username='oryx', principal='oryx/127.3.98.188@KRBTEST.COM'} at 127.0.0.1:45090)
I20260806 00:53:30.199193 11929 tablet_copy_service.cc:161] P 7bef2a3e691043d78c4315565b15c55c: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer aeaa49fd09c9478a9b5b2a64107268f3 at {username='oryx', principal='oryx/127.3.98.188@KRBTEST.COM'} at 127.0.0.1:45090: session id = aeaa49fd09c9478a9b5b2a64107268f3-00000000000000000000000000000000
I20260806 00:53:30.199633 11929 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 00:53:30.200187 12776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 00:53:30.201529 12776 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: tablet copy: Starting download of 0 data blocks...
I20260806 00:53:30.201727 12776 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: tablet copy: Starting download of 1 WAL segments...
I20260806 00:53:30.202476 12776 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 00:53:30.203255 11929 tablet_copy_service.cc:342] P 7bef2a3e691043d78c4315565b15c55c: Request end of tablet copy session aeaa49fd09c9478a9b5b2a64107268f3-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.3.98.188@KRBTEST.COM'} at 127.0.0.1:45090
I20260806 00:53:30.203320 11929 tablet_copy_service.cc:433] P 7bef2a3e691043d78c4315565b15c55c: ending tablet copy session aeaa49fd09c9478a9b5b2a64107268f3-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer aeaa49fd09c9478a9b5b2a64107268f3
I20260806 00:53:30.205904 12776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:30.207020 12915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:30.207095 12917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:30.207163 12776 server_base.cc:1034] running on GCE node
W20260806 00:53:30.207273 12920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:30.207453 12776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:30.207610 12776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:30.208729 12776 hybrid_clock.cc:648] HybridClock initialized: now 1785977610208709 us; error 35 us; skew 500 ppm
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:30.210197 12776 init.cc:377] Logged in from keytab as oryx/127.3.98.188@KRBTEST.COM (short username oryx)
I20260806 00:53:30.210458 12776 webserver.cc:460] Webserver started at http://127.3.98.188:40391/ using document root <none> and password file <none>
I20260806 00:53:30.210582 12776 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:30.210619 12776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:30.211360 12776 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:30.212010 12927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.212181 12776 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.212239 12776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/wal
uuid: "aeaa49fd09c9478a9b5b2a64107268f3"
format_stamp: "Formatted at 2026-08-06 00:53:30 on dist-test-slave-44d2"
server_key: "c7c41950ea617b1fd1d77ac94b2ca732"
server_key_iv: "02256fd75a8899d0902820f630d1ca8f"
server_key_version: "encryptionkey@0"
I20260806 00:53:30.212289 12776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:30.218520 12776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:30.220208 12776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:30.223845 12776 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.188:42877
I20260806 00:53:30.224231 13000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.188:42877 every 8 connection(s)
I20260806 00:53:30.224301 12776 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/master-2/data/info.pb
I20260806 00:53:30.225072 13002 sys_catalog.cc:263] Verifying existing consensus state
I20260806 00:53:30.225471 13002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: Bootstrap starting.
I20260806 00:53:30.228070 13002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 00:53:30.228299 13002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: Bootstrap complete.
I20260806 00:53:30.228586 13002 raft_consensus.cc:348] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } }
I20260806 00:53:30.228679 13002 raft_consensus.cc:729] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: aeaa49fd09c9478a9b5b2a64107268f3, State: Initialized, Role: LEARNER
I20260806 00:53:30.228730 13002 consensus_queue.cc:260] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } }
I20260806 00:53:30.228911 13002 sys_catalog.cc:564] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:30.228904 13007 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } } }
I20260806 00:53:30.229123 13007 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: This master's current role is: LEARNER
I20260806 00:53:30.230484 13022 catalog_manager.cc:1259] Loaded cluster ID: 1f988396248f42d78eb9c509cb2ac5c1
I20260806 00:53:30.230574 13022 catalog_manager.cc:1552] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: loading cluster ID for follower catalog manager: success
I20260806 00:53:30.231688 13022 catalog_manager.cc:1574] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: acquiring CA information for follower catalog manager: success
I20260806 00:53:30.232043 13022 catalog_manager.cc:1602] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 00:53:30.236223 13005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.225863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55506 (local address 127.3.98.188:42877)
0806 00:53:30.228599 (+ 2736us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.228601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.228612 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:53:30.228637 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.228638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.228650 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.229461 (+ 811us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.229500 (+ 39us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.230502 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.231562 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.231869 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.231935 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.233268 (+ 1333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.233270 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.233270 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.233277 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.235000 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.235363 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.235364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.235364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.235455 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.235680 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.235681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.235682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.235816 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.235935 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.236011 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.236106 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2706,"thread_start_us":78,"threads_started":1}
I20260806 00:53:30.236771 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 11989
I20260806 00:53:30.247105 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:40359
--local_ip_for_outbound_sockets=127.3.98.129
--tserver_master_addrs=127.3.98.190:35873
--webserver_port=44529
--webserver_interface=127.3.98.129
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab
--principal=oryx/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.3.98.190:35873,127.3.98.189:46075
--tserver_master_addrs=127.3.98.190:35873,127.3.98.189:46075,127.3.98.188:42877 with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:30.340855 13023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:30.341066 13023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:30.341094 13023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:30.342587 13023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:30.342651 13023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:30.342703 13023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:30.344333 13023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab
--principal=oryx/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:40359
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=44529
--tserver_master_addrs=127.3.98.190:35873,127.3.98.189:46075,127.3.98.188:42877
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:30.344587 13023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:30.344834 13023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:30.349838 13033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:30.349859 13030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:30.349825 13031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:30.350132 13023 server_base.cc:1034] running on GCE node
I20260806 00:53:30.350337 13023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:30.350603 13023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:30.351763 13023 hybrid_clock.cc:648] HybridClock initialized: now 1785977610351753 us; error 27 us; skew 500 ppm
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:30.354383 13023 init.cc:377] Logged in from keytab as oryx/127.3.98.129@KRBTEST.COM (short username oryx)
I20260806 00:53:30.354769 13023 webserver.cc:460] Webserver started at http://127.3.98.129:44529/ using document root <none> and password file <none>
I20260806 00:53:30.354945 13023 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:30.355002 13023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:30.356294 13023 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:30.356956 13041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.357120 13023 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.357205 13023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "1ad9d673898647c3b6365e895eb1d9a0"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "3bbf508c538ba842d1c415d270c118b4"
server_key_iv: "5d381ede0f57d135ef62e0143a1283bd"
server_key_version: "encryptionkey@0"
I20260806 00:53:30.357507 13023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:30.374764 13023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:30.377199 13023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:30.377324 13023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:30.377530 13023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:30.377874 13023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:30.377911 13023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.377934 13023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:30.377982 13023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.384689 13023 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:40359
I20260806 00:53:30.384780 13195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:40359 every 8 connection(s)
I20260806 00:53:30.385139 13023 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.188@KRBTEST.COM
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
I20260806 00:53:30.393759 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 13023
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.189@KRBTEST.COM
I20260806 00:53:30.393947 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 12172
I20260806 00:53:30.398347 13005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.386168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:44131 (local address 127.3.98.188:42877)
0806 00:53:30.386221 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.386223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.386363 (+ 140us) server_negotiation.cc:407] Connection header received
0806 00:53:30.386864 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.386865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.386876 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.386956 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.389216 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.389683 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.390593 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.390903 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.390960 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.393132 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.393134 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.393134 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.393143 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.396752 (+ 3609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.397220 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.397221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.397222 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.397278 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.397529 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.397529 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.397530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.397679 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.397748 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.398126 (+ 378us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.398223 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 00:53:30.398916 13203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.385915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:42877 (local address 127.3.98.129:44131)
0806 00:53:30.386242 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.386287 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.386778 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.387055 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.387064 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.387744 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.387983 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.387989 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.389781 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.389782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.390513 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.390517 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.390982 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.390983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.391070 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.391519 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.391524 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.393038 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.396835 (+ 3797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.396843 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.396845 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.397137 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.397346 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.397346 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.397347 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.397450 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.397778 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.397785 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.397948 (+ 163us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.398533 (+ 585us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.398711 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":11,"thread_start_us":95,"threads_started":1}
I20260806 00:53:30.399446 13197 heartbeater.cc:347] Connected to a master server at 127.3.98.188:42877
I20260806 00:53:30.399585 13197 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:30.399776 13197 heartbeater.cc:511] Master 127.3.98.188:42877 requested a full tablet report, sending...
I20260806 00:53:30.399937 12772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.386221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:35779 (local address 127.3.98.189:46075)
0806 00:53:30.386261 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.386263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.386988 (+ 725us) server_negotiation.cc:407] Connection header received
0806 00:53:30.387056 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.387058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.387078 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.387140 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.388581 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.389129 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.390149 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.390348 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.390481 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.394491 (+ 4010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.394492 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.394493 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.394501 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.398244 (+ 3743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.398759 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.398761 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.398761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.398845 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.399151 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.399152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.399152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.399342 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.399401 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.399676 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.399785 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 00:53:30.400385 12951 ts_manager.cc:194] Registered new tserver with Master: 1ad9d673898647c3b6365e895eb1d9a0 (127.3.98.129:40359)
I20260806 00:53:30.400408 13202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.385915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:46075 (local address 127.3.98.129:35779)
0806 00:53:30.386913 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.386921 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.386991 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.387161 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.387162 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.387744 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.387983 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.387990 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.389207 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.389208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.390047 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.390049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.390466 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.390467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.390621 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.391309 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.391320 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.394406 (+ 3086us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.398337 (+ 3931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.398339 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.398339 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.398637 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.398943 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.398944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.398945 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.399031 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.399463 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.399464 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.399520 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.400053 (+ 533us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.400207 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":973,"mutex_wait_us":3,"thread_start_us":75,"threads_started":1}
I20260806 00:53:30.406953 13200 heartbeater.cc:347] Connected to a master server at 127.3.98.189:46075
I20260806 00:53:30.407040 13200 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:30.407135 13200 heartbeater.cc:511] Master 127.3.98.189:46075 requested a full tablet report, sending...
I20260806 00:53:30.407984 12699 ts_manager.cc:194] Registered new tserver with Master: 1ad9d673898647c3b6365e895eb1d9a0 (127.3.98.129:40359)
I20260806 00:53:30.410079 13204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.385916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.129:40387)
0806 00:53:30.387109 (+ 1193us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.387119 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.387193 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.387345 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.387346 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.387720 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.387981 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.387986 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.388809 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.388810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.389999 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.390002 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.390534 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.390535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.390629 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.391344 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.391350 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.394140 (+ 2790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.408928 (+ 14788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.408930 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.408930 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.409134 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.409370 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.409371 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.409372 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.409431 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.409762 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.409763 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.409822 (+ 59us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.409876 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.409980 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1154,"mutex_wait_us":82,"thread_start_us":99,"threads_started":1}
I20260806 00:53:30.410184 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.386025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:40387 (local address 127.3.98.190:35873)
0806 00:53:30.386076 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.386078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.387167 (+ 1089us) server_negotiation.cc:407] Connection header received
0806 00:53:30.387250 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.387252 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.387263 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.387340 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.388096 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.388707 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.390095 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.390403 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.390471 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.405897 (+ 15426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.405900 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.405900 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.405912 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.408835 (+ 2923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.409220 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.409221 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.409221 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.409300 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.409493 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.409494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.409494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.409659 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.409751 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.409936 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.410038 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 00:53:30.410619 13198 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35873
I20260806 00:53:30.410682 13198 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:30.410763 13198 heartbeater.cc:511] Master 127.3.98.190:35873 requested a full tablet report, sending...
I20260806 00:53:30.411080 11897 ts_manager.cc:194] Re-registered known tserver with Master: 1ad9d673898647c3b6365e895eb1d9a0 (127.3.98.129:40359)
I20260806 00:53:30.411525 11897 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:40387
I20260806 00:53:30.413007 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:34691
--local_ip_for_outbound_sockets=127.3.98.130
--tserver_master_addrs=127.3.98.190:35873
--webserver_port=39541
--webserver_interface=127.3.98.130
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab
--principal=oryx/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.3.98.190:35873,127.3.98.189:46075
--tserver_master_addrs=127.3.98.190:35873,127.3.98.189:46075,127.3.98.188:42877 with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:30.498718 13205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:30.498997 13205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:30.499042 13205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:30.500197 13205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:30.500277 13205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:30.500324 13205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:30.501835 13205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab
--principal=oryx/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:34691
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=39541
--tserver_master_addrs=127.3.98.190:35873,127.3.98.189:46075,127.3.98.188:42877
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:30.502123 13205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:30.502384 13205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:30.507550 13213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:30.507556 13211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:30.507612 13210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:30.508008 13205 server_base.cc:1034] running on GCE node
I20260806 00:53:30.508176 13205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:30.508374 13205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:30.509541 13205 hybrid_clock.cc:648] HybridClock initialized: now 1785977610509530 us; error 44 us; skew 500 ppm
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:30.512377 13205 init.cc:377] Logged in from keytab as oryx/127.3.98.130@KRBTEST.COM (short username oryx)
I20260806 00:53:30.512880 13205 webserver.cc:460] Webserver started at http://127.3.98.130:39541/ using document root <none> and password file <none>
I20260806 00:53:30.513161 13205 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:30.513255 13205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:30.514612 13205 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:30.515439 13221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.515661 13205 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:30.515789 13205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "19c13f490efb412195a794a3feb8fb41"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "3028cb237ce4e8280ed15895eeae2828"
server_key_iv: "b9eb24323af3856a598e2db9d9190c57"
server_key_version: "encryptionkey@0"
I20260806 00:53:30.516204 13205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:30.536332 13205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:30.539263 13205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:30.539429 13205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:30.539729 13205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:30.540131 13205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:30.540182 13205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.540217 13205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:30.540246 13205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.549626 13205 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:34691
I20260806 00:53:30.549696 13361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:34691 every 8 connection(s)
I20260806 00:53:30.550220 13205 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:30.558662 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 13205
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.189@KRBTEST.COM
I20260806 00:53:30.558851 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 12349
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.188@KRBTEST.COM
I20260806 00:53:30.568372 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.551701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:52955 (local address 127.3.98.190:35873)
0806 00:53:30.551771 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.551773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.551785 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:53:30.552242 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.552244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.552257 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.552290 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.553439 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.554226 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.555907 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.556205 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.556250 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.564235 (+ 7985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.564237 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.564237 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.564245 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.566188 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.566863 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.566864 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.566864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.566939 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.567406 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.567408 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.567408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.567684 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.567728 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.568149 (+ 421us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.568253 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 00:53:30.568732 12772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.551087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:42011 (local address 127.3.98.189:46075)
0806 00:53:30.551139 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.551141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.551473 (+ 332us) server_negotiation.cc:407] Connection header received
0806 00:53:30.552248 (+ 775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.552250 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.552264 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.552297 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.553438 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.554268 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.555927 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.556279 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.556326 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.564124 (+ 7798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.564125 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.564126 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.564134 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.566200 (+ 2066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.566862 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.566863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.566863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.567017 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.568087 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.568088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.568089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.568247 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.568293 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.568532 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.568640 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 00:53:30.569334 13367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.551073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:46075 (local address 127.3.98.130:42011)
0806 00:53:30.551326 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.551378 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.552114 (+ 736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.552510 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.552516 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.552990 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.553321 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.553327 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.554381 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.554382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.555800 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.555803 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.556417 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.556417 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.556528 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.557210 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.557222 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.564011 (+ 6789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.566294 (+ 2283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.566296 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.566296 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.566773 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.567093 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.567094 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.567095 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.567351 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.568343 (+ 992us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.568343 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.568385 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.568830 (+ 445us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.569068 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"mutex_wait_us":136,"thread_start_us":136,"threads_started":1}
I20260806 00:53:30.569891 13005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.551745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:50747 (local address 127.3.98.188:42877)
0806 00:53:30.551798 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.551800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.551808 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:53:30.552243 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.552244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.552256 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.552290 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.553448 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.554244 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.555907 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.556208 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.556250 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.560742 (+ 4492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.560744 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.560745 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.560754 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.564136 (+ 3382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.566969 (+ 2833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.566970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.566971 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.567035 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.567441 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.567442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.567443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.567603 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.567666 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.569685 (+ 2019us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.569794 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 00:53:30.569914 13369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.551073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.130:52955)
0806 00:53:30.551326 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.551378 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.552128 (+ 750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.552529 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.552530 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.553011 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.553321 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.553327 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.554373 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.554374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.555797 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.555800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.556348 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.556349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.556515 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.557255 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.557261 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.563690 (+ 6429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.566487 (+ 2797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.566488 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.566489 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.566773 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.567265 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.567266 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.567266 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.567324 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.567774 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.567774 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.567917 (+ 143us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.569168 (+ 1251us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.569267 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":92,"thread_start_us":151,"threads_started":1}
I20260806 00:53:30.569960 13365 heartbeater.cc:347] Connected to a master server at 127.3.98.189:46075
I20260806 00:53:30.570402 13370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.551446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:42877 (local address 127.3.98.130:50747)
0806 00:53:30.551578 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.551590 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.552128 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.552904 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.552905 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.553077 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.553321 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.553327 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.554373 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.554374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.555797 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.555800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.556346 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.556347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.556515 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.557378 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.557382 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.560607 (+ 3225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.564524 (+ 3917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.564534 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.564536 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.566656 (+ 2120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.567114 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.567115 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.567115 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.567282 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.567706 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.567714 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.567917 (+ 203us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.570045 (+ 2128us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.570157 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":189,"thread_start_us":286,"threads_started":1}
I20260806 00:53:30.570456 13365 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:30.570860 13362 heartbeater.cc:347] Connected to a master server at 127.3.98.188:42877
I20260806 00:53:30.570925 13362 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:30.571067 13362 heartbeater.cc:511] Master 127.3.98.188:42877 requested a full tablet report, sending...
I20260806 00:53:30.570863 13364 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35873
I20260806 00:53:30.571336 13364 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:30.571403 13364 heartbeater.cc:511] Master 127.3.98.190:35873 requested a full tablet report, sending...
I20260806 00:53:30.571472 13365 heartbeater.cc:511] Master 127.3.98.189:46075 requested a full tablet report, sending...
I20260806 00:53:30.571600 12951 ts_manager.cc:194] Registered new tserver with Master: 19c13f490efb412195a794a3feb8fb41 (127.3.98.130:34691)
I20260806 00:53:30.571699 11897 ts_manager.cc:194] Re-registered known tserver with Master: 19c13f490efb412195a794a3feb8fb41 (127.3.98.130:34691)
I20260806 00:53:30.571740 12699 ts_manager.cc:194] Registered new tserver with Master: 19c13f490efb412195a794a3feb8fb41 (127.3.98.130:34691)
I20260806 00:53:30.572419 11897 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:52955
I20260806 00:53:30.578157 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:43081
--local_ip_for_outbound_sockets=127.3.98.131
--tserver_master_addrs=127.3.98.190:35873
--webserver_port=36545
--webserver_interface=127.3.98.131
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab
--principal=oryx/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.3.98.190:35873,127.3.98.189:46075
--tserver_master_addrs=127.3.98.190:35873,127.3.98.189:46075,127.3.98.188:42877 with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:30.672864 13372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:30.673051 13372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:30.673074 13372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:30.674258 13372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:30.674307 13372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:30.674333 13372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:30.675828 13372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab
--principal=oryx/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:43081
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=36545
--tserver_master_addrs=127.3.98.190:35873,127.3.98.189:46075,127.3.98.188:42877
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:30.676084 13372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:30.676312 13372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:30.681547 13378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:30.681547 13379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:30.681602 13372 server_base.cc:1034] running on GCE node
W20260806 00:53:30.681559 13381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:30.681946 13372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:30.682188 13372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:30.683352 13372 hybrid_clock.cc:648] HybridClock initialized: now 1785977610683349 us; error 37 us; skew 500 ppm
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:30.685899 13372 init.cc:377] Logged in from keytab as oryx/127.3.98.131@KRBTEST.COM (short username oryx)
I20260806 00:53:30.686369 13372 webserver.cc:460] Webserver started at http://127.3.98.131:36545/ using document root <none> and password file <none>
I20260806 00:53:30.686623 13372 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:30.686717 13372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:30.688058 13372 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:30.688694 13388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.688882 13372 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:30.688997 13372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "fc3e44d75413441683e21e65eb13473f"
format_stamp: "Formatted at 2026-08-06 00:53:29 on dist-test-slave-44d2"
server_key: "528156196368fdb78e8fda351e7be52d"
server_key_iv: "12df806da3f18f5e467f2825e966e143"
server_key_version: "encryptionkey@0"
I20260806 00:53:30.689383 13372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:30.709550 13372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:30.711675 13372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:30.712061 13372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:30.712323 13372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:30.712733 13372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:30.712790 13372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.712833 13372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:30.712860 13372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:30.719594 13372 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:43081
I20260806 00:53:30.719666 13536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:43081 every 8 connection(s)
I20260806 00:53:30.720031 13372 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.188@KRBTEST.COM
Aug 06 00:53:30 dist-test-slave-44d2 krb5kdc[11841](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977610, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.189@KRBTEST.COM
I20260806 00:53:30.729732 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 13372
I20260806 00:53:30.731052 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.720930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:39137 (local address 127.3.98.190:35873)
0806 00:53:30.721099 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.721101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.721355 (+ 254us) server_negotiation.cc:407] Connection header received
0806 00:53:30.721874 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.721876 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.721889 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.722025 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.722690 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.723202 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.724242 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.724439 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.724549 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.727042 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.727044 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.727044 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.727053 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.728828 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.729788 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.729789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.729790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.729856 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.730210 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.730211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.730212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.730375 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.730423 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.730843 (+ 420us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.730928 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260806 00:53:30.731668 13544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.720837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.131:39137)
0806 00:53:30.721262 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.721272 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.721772 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.722117 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.722120 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.722400 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.722597 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.722601 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.723306 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.723307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.724141 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.724143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.724574 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.724576 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.724742 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.725307 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.725316 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.726941 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.729261 (+ 2320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.729268 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.729270 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.729687 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.729979 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.729980 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.729980 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.730127 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.730491 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.730499 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.730669 (+ 170us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.731232 (+ 563us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.731416 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"mutex_wait_us":182,"thread_start_us":66,"threads_started":1}
I20260806 00:53:30.731698 12772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.720942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:35523 (local address 127.3.98.189:46075)
0806 00:53:30.720992 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.720994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.721322 (+ 328us) server_negotiation.cc:407] Connection header received
0806 00:53:30.721899 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.721901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.721914 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.721947 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.722784 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.723519 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.724675 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.724990 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.725073 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.728203 (+ 3130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.728205 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.728205 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.728213 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.730223 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.730710 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.730711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.730712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.730777 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.731001 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.731002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.731003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.731164 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.731214 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.731502 (+ 288us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.731596 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:53:30.731725 13005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.721099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:52263 (local address 127.3.98.188:42877)
0806 00:53:30.721148 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.721150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.721344 (+ 194us) server_negotiation.cc:407] Connection header received
0806 00:53:30.721900 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.721901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.721914 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.721947 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.722713 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.723513 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.724701 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.724911 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.725002 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.728063 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.728065 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.728065 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.728074 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.730046 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.730541 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.730542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.730542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.730602 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.730812 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.730813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.730813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.730940 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.730983 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.731546 (+ 563us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.731627 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:53:30.732163 13540 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35873
I20260806 00:53:30.732275 13540 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:30.732295 13545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.720838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:46075 (local address 127.3.98.131:35523)
0806 00:53:30.721172 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.721216 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.721762 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.722488 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.722489 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.722636 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.722696 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.722698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.723618 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.723619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.724593 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.724595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.725072 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.725073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.725141 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.725696 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.725701 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.728121 (+ 2420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.730334 (+ 2213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.730335 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.730335 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.730605 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.730859 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.730859 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.730860 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.730924 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.731270 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.731271 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.731336 (+ 65us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.731999 (+ 663us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.732113 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"mutex_wait_us":58,"thread_start_us":104,"threads_started":1}
I20260806 00:53:30.732514 13540 heartbeater.cc:511] Master 127.3.98.190:35873 requested a full tablet report, sending...
I20260806 00:53:30.732831 13543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.720837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:42877 (local address 127.3.98.131:52263)
0806 00:53:30.721172 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.721216 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.721761 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.722101 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.722106 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.722435 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:30.722599 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.722604 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.723618 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.723619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.724593 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.724595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.725060 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.725061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.725139 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.725618 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:30.725623 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:30.727938 (+ 2315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:30.730204 (+ 2266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.730204 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.730205 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.730458 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.730671 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:30.730672 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:30.730672 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:30.730735 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:30.731032 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:30.731033 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:30.731072 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.732534 (+ 1462us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.732710 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":47,"thread_start_us":119,"threads_started":1}
I20260806 00:53:30.732861 13541 heartbeater.cc:347] Connected to a master server at 127.3.98.189:46075
I20260806 00:53:30.732930 13541 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:30.732920 11897 ts_manager.cc:194] Re-registered known tserver with Master: fc3e44d75413441683e21e65eb13473f (127.3.98.131:43081)
I20260806 00:53:30.733008 13541 heartbeater.cc:511] Master 127.3.98.189:46075 requested a full tablet report, sending...
I20260806 00:53:30.733165 13538 heartbeater.cc:347] Connected to a master server at 127.3.98.188:42877
I20260806 00:53:30.733211 13538 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:30.733265 13538 heartbeater.cc:511] Master 127.3.98.188:42877 requested a full tablet report, sending...
I20260806 00:53:30.733350 12699 ts_manager.cc:194] Registered new tserver with Master: fc3e44d75413441683e21e65eb13473f (127.3.98.131:43081)
I20260806 00:53:30.733424 11897 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:39137
I20260806 00:53:30.733527 12951 ts_manager.cc:194] Registered new tserver with Master: fc3e44d75413441683e21e65eb13473f (127.3.98.131:43081)
I20260806 00:53:30.740339 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.731066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36374 (local address 127.3.98.190:35873)
0806 00:53:30.731154 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.731156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.731533 (+ 377us) server_negotiation.cc:407] Connection header received
0806 00:53:30.731629 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.731630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.731640 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.731668 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.733586 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.734181 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.735329 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.735543 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.735623 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.737347 (+ 1724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.737348 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.737348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.737355 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.739130 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.739540 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.739541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.739541 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.739598 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.739811 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.739812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.739813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.739931 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.740036 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.740140 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.740216 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66,"thread_start_us":112,"threads_started":1}
I20260806 00:53:30.742511 13005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.734316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55522 (local address 127.3.98.188:42877)
0806 00:53:30.734362 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.734364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.734475 (+ 111us) server_negotiation.cc:407] Connection header received
0806 00:53:30.734506 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.734508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.734518 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.734581 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.735282 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.736010 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.736808 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.737016 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.737098 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.739169 (+ 2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.739170 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.739170 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.739177 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.741361 (+ 2184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.741771 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.741772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.741772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.741855 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.742051 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.742053 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.742053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.742181 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.742278 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.742353 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.742424 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 00:53:30.742075 11897 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36374:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:30.744050 11897 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:30.746017 12772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.734676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58362 (local address 127.3.98.189:46075)
0806 00:53:30.734719 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.734721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.734968 (+ 247us) server_negotiation.cc:407] Connection header received
0806 00:53:30.735036 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.735037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.735047 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.735102 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:30.736169 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.736997 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.737775 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.738158 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.738218 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.739493 (+ 1275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:30.739494 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:30.739495 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:30.739502 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:30.741625 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.745092 (+ 3467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.745093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.745093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.745157 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:30.745437 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:30.745438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:30.745438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:30.745538 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:30.745609 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.745811 (+ 202us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.745914 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:53:30.752825 13560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.748441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:40359 (local address 127.0.0.1:55074)
0806 00:53:30.749095 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.749105 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.749174 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.749489 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.749490 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.749491 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:30.749525 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.749526 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.750801 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.750802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.751838 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.751839 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.752589 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.752591 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.752653 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.752657 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.752708 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.752749 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":134,"threads_started":1}
I20260806 00:53:30.753044 13565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.748732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55074 (local address 127.3.98.129:40359)
0806 00:53:30.749089 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.749094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.749154 (+ 60us) server_negotiation.cc:407] Connection header received
0806 00:53:30.749248 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.749249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.749267 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.749351 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:30.749615 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.750714 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.751926 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.752425 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.752588 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.752685 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.752720 (+ 35us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.752757 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":238,"threads_started":1}
I20260806 00:53:30.753137 13562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.748344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:43081 (local address 127.0.0.1:56776)
0806 00:53:30.748614 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.748626 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.748681 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.749347 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.749347 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.749349 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:30.749391 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.749392 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.750899 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.750900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.751731 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.751733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.752756 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.752757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.752856 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.752859 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.752906 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.752954 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":28,"thread_start_us":87,"threads_started":1}
I20260806 00:53:30.753185 13561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.748421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:34691 (local address 127.0.0.1:37682)
0806 00:53:30.748999 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.749011 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.749071 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.749592 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.749593 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.749596 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:30.749654 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.749656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.750517 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.750518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.751621 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.751624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.752756 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.752757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.752846 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.752851 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.752906 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.752953 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"mutex_wait_us":3,"thread_start_us":87,"threads_started":1}
I20260806 00:53:30.753465 13564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.748668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37682 (local address 127.3.98.130:34691)
0806 00:53:30.748842 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.748847 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.749421 (+ 574us) server_negotiation.cc:407] Connection header received
0806 00:53:30.749486 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.749488 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.749501 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.749593 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:30.749712 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.750407 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.751726 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.752530 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.752628 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.752716 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.753295 (+ 579us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.753368 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":101,"threads_started":1}
I20260806 00:53:30.753898 13108 tablet_service.cc:1467] Processing CreateTablet for tablet 3f021c49c28c4d5a86fbb4160a2b679a (DEFAULT_TABLE table=test-table [id=b85a25179b19477a9e179c4bd1c71656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:30.754326 13108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f021c49c28c4d5a86fbb4160a2b679a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:30.754226 13284 tablet_service.cc:1467] Processing CreateTablet for tablet 3f021c49c28c4d5a86fbb4160a2b679a (DEFAULT_TABLE table=test-table [id=b85a25179b19477a9e179c4bd1c71656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:30.754585 13284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f021c49c28c4d5a86fbb4160a2b679a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:30.758510 13566 tablet_bootstrap.cc:492] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0: Bootstrap starting.
I20260806 00:53:30.758567 13567 tablet_bootstrap.cc:492] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41: Bootstrap starting.
I20260806 00:53:30.758675 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.748474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56776 (local address 127.3.98.131:43081)
0806 00:53:30.749191 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.749195 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.749205 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:30.749247 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.749249 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.749267 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.749351 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:30.749476 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.750650 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.751859 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.752653 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.758403 (+ 5750us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.758503 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.758533 (+ 30us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.758579 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":94,"threads_started":1}
I20260806 00:53:30.759277 13567 tablet_bootstrap.cc:654] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:30.759277 13566 tablet_bootstrap.cc:654] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:30.759264 13453 tablet_service.cc:1467] Processing CreateTablet for tablet 3f021c49c28c4d5a86fbb4160a2b679a (DEFAULT_TABLE table=test-table [id=b85a25179b19477a9e179c4bd1c71656]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:30.759636 13453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f021c49c28c4d5a86fbb4160a2b679a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:30.759671 13567 log.cc:824] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:30.759703 13566 log.cc:824] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:30.760600 13567 tablet_bootstrap.cc:492] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41: No bootstrap required, opened a new log
I20260806 00:53:30.760676 13567 ts_tablet_manager.cc:1397] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:53:30.760852 13566 tablet_bootstrap.cc:492] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0: No bootstrap required, opened a new log
I20260806 00:53:30.760934 13566 ts_tablet_manager.cc:1397] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 00:53:30.762609 13567 raft_consensus.cc:348] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } }
I20260806 00:53:30.762768 13567 raft_consensus.cc:374] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:30.762811 13567 raft_consensus.cc:729] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19c13f490efb412195a794a3feb8fb41, State: Initialized, Role: FOLLOWER
I20260806 00:53:30.762928 13567 consensus_queue.cc:260] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } }
I20260806 00:53:30.763222 13567 ts_tablet_manager.cc:1428] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:53:30.763116 13566 raft_consensus.cc:348] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } }
I20260806 00:53:30.763268 13566 raft_consensus.cc:374] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:30.763309 13364 heartbeater.cc:503] Master 127.3.98.190:35873 was elected leader, sending a full tablet report...
I20260806 00:53:30.763305 13566 raft_consensus.cc:729] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad9d673898647c3b6365e895eb1d9a0, State: Initialized, Role: FOLLOWER
I20260806 00:53:30.763453 13566 consensus_queue.cc:260] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } }
I20260806 00:53:30.763939 13566 ts_tablet_manager.cc:1428] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 00:53:30.764055 13198 heartbeater.cc:503] Master 127.3.98.190:35873 was elected leader, sending a full tablet report...
I20260806 00:53:30.765487 13571 tablet_bootstrap.cc:492] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f: Bootstrap starting.
I20260806 00:53:30.766076 13571 tablet_bootstrap.cc:654] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:30.766376 13571 log.cc:824] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:30.767130 13571 tablet_bootstrap.cc:492] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f: No bootstrap required, opened a new log
I20260806 00:53:30.767189 13571 ts_tablet_manager.cc:1397] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:53:30.768841 13571 raft_consensus.cc:348] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } }
I20260806 00:53:30.768976 13571 raft_consensus.cc:374] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:30.768999 13571 raft_consensus.cc:729] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc3e44d75413441683e21e65eb13473f, State: Initialized, Role: FOLLOWER
I20260806 00:53:30.769170 13571 consensus_queue.cc:260] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } }
I20260806 00:53:30.769461 13571 ts_tablet_manager.cc:1428] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:53:30.769515 13540 heartbeater.cc:503] Master 127.3.98.190:35873 was elected leader, sending a full tablet report...
I20260806 00:53:30.779637 13005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.777305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55526 (local address 127.3.98.188:42877)
0806 00:53:30.777369 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:30.777371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:30.777395 (+ 24us) server_negotiation.cc:407] Connection header received
0806 00:53:30.777415 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:30.777415 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:30.777436 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:30.777484 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:30.777630 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.778129 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.778993 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.779378 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.779435 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.779484 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:30.779553 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 00:53:30.779584 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 00:53:30.779641 13561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:30.777234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:42877 (local address 127.0.0.1:55526)
0806 00:53:30.777297 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:30.777310 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:30.777364 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:30.777498 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:30.777499 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:30.777500 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:30.777546 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.777547 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.778189 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.778189 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.778906 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:30.778908 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:30.779449 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:30.779451 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:30.779499 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:30.779503 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:30.779548 (+ 45us) client_negotiation.cc:240] Negotiation successful
0806 00:53:30.779586 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 00:53:30.780083 12963 raft_consensus.cc:1203] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260806 00:53:30.781030 13575 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bef2a3e691043d78c4315565b15c55c. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } } }
I20260806 00:53:30.781133 13575 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: This master's current role is: LEARNER
W20260806 00:53:30.801714 13366 tablet.cc:2369] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 00:53:30.886117 13201 tablet.cc:2369] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 00:53:30.971325 13542 tablet.cc:2369] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:53:31.063544 13572 raft_consensus.cc:482] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:31.063750 13572 raft_consensus.cc:504] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } }
I20260806 00:53:31.064329 13572 leader_election.cc:288] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc3e44d75413441683e21e65eb13473f (127.3.98.131:43081), 19c13f490efb412195a794a3feb8fb41 (127.3.98.130:34691)
I20260806 00:53:31.068445 13564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:31.064630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:57783 (local address 127.3.98.130:34691)
0806 00:53:31.064693 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:31.064696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:31.064923 (+ 227us) server_negotiation.cc:407] Connection header received
0806 00:53:31.065041 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:31.065042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:31.065058 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:31.065114 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:31.065298 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.066014 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.067466 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.068046 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.068119 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:31.068128 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:31.068335 (+ 207us) server_negotiation.cc:299] Negotiation successful
0806 00:53:31.068374 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 00:53:31.068565 13583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:31.064541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:43081 (local address 127.3.98.129:56469)
0806 00:53:31.064789 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:31.064803 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:31.064897 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:31.065109 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:31.065111 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:31.065113 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:31.065173 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:31.065176 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.065932 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.065933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:31.067363 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:31.067365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.068148 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.068149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:31.068252 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:31.068259 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 00:53:31.068328 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 00:53:31.068399 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":32,"thread_start_us":63,"threads_started":1}
I20260806 00:53:31.068575 13584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:31.064694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:34691 (local address 127.3.98.129:57783)
0806 00:53:31.064851 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:31.064862 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:31.064956 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:31.065133 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:31.065134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:31.065137 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:31.065205 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:31.065207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.066111 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.066112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:31.067359 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:31.067362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.068167 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.068168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:31.068228 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:31.068232 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:31.068310 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 00:53:31.068358 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":4,"thread_start_us":95,"threads_started":1}
I20260806 00:53:31.068722 13563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:31.064606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:56469 (local address 127.3.98.131:43081)
0806 00:53:31.064664 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:31.064667 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:31.064894 (+ 227us) server_negotiation.cc:407] Connection header received
0806 00:53:31.064965 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:31.064966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:31.064989 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:31.065048 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:31.065266 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.065823 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.067469 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.068038 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.068119 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:31.068128 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:31.068587 (+ 459us) server_negotiation.cc:299] Negotiation successful
0806 00:53:31.068642 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 00:53:31.069080 13308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f021c49c28c4d5a86fbb4160a2b679a" candidate_uuid: "1ad9d673898647c3b6365e895eb1d9a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19c13f490efb412195a794a3feb8fb41" is_pre_election: true
I20260806 00:53:31.069257 13308 raft_consensus.cc:2454] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad9d673898647c3b6365e895eb1d9a0 in term 0.
I20260806 00:53:31.069260 13482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f021c49c28c4d5a86fbb4160a2b679a" candidate_uuid: "1ad9d673898647c3b6365e895eb1d9a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc3e44d75413441683e21e65eb13473f" is_pre_election: true
I20260806 00:53:31.069376 13482 raft_consensus.cc:2454] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ad9d673898647c3b6365e895eb1d9a0 in term 0.
I20260806 00:53:31.069494 13044 leader_election.cc:302] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19c13f490efb412195a794a3feb8fb41, 1ad9d673898647c3b6365e895eb1d9a0; no voters:
I20260806 00:53:31.069625 13572 raft_consensus.cc:2781] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:31.069722 13572 raft_consensus.cc:482] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:31.069762 13572 raft_consensus.cc:3037] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:31.070565 13572 raft_consensus.cc:504] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } }
I20260806 00:53:31.070742 13572 leader_election.cc:288] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [CANDIDATE]: Term 1 election: Requested vote from peers fc3e44d75413441683e21e65eb13473f (127.3.98.131:43081), 19c13f490efb412195a794a3feb8fb41 (127.3.98.130:34691)
I20260806 00:53:31.070902 13308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f021c49c28c4d5a86fbb4160a2b679a" candidate_uuid: "1ad9d673898647c3b6365e895eb1d9a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19c13f490efb412195a794a3feb8fb41"
I20260806 00:53:31.070919 13482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f021c49c28c4d5a86fbb4160a2b679a" candidate_uuid: "1ad9d673898647c3b6365e895eb1d9a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc3e44d75413441683e21e65eb13473f"
I20260806 00:53:31.070988 13308 raft_consensus.cc:3037] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:31.070999 13482 raft_consensus.cc:3037] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:31.071825 13482 raft_consensus.cc:2454] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad9d673898647c3b6365e895eb1d9a0 in term 1.
I20260806 00:53:31.071828 13308 raft_consensus.cc:2454] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ad9d673898647c3b6365e895eb1d9a0 in term 1.
I20260806 00:53:31.072029 13042 leader_election.cc:302] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad9d673898647c3b6365e895eb1d9a0, fc3e44d75413441683e21e65eb13473f; no voters:
I20260806 00:53:31.072170 13572 raft_consensus.cc:2781] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:31.072283 13572 raft_consensus.cc:686] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [term 1 LEADER]: Becoming Leader. State: Replica: 1ad9d673898647c3b6365e895eb1d9a0, State: Running, Role: LEADER
I20260806 00:53:31.072398 13572 consensus_queue.cc:237] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } }
I20260806 00:53:31.073484 11896 catalog_manager.cc:5495] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ad9d673898647c3b6365e895eb1d9a0 (127.3.98.129). New cstate: current_term: 1 leader_uuid: "1ad9d673898647c3b6365e895eb1d9a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } health_report { overall_health: UNKNOWN } } }
I20260806 00:53:31.074187 13556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: NON_VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: true } } }
I20260806 00:53:31.074317 13556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:31.075356 13589 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c: attempting to promote NON_VOTER aeaa49fd09c9478a9b5b2a64107268f3 to VOTER
I20260806 00:53:31.075662 13589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } }
I20260806 00:53:31.076079 12963 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 LEARNER]: Refusing update from remote peer 7bef2a3e691043d78c4315565b15c55c: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260806 00:53:31.076087 12712 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 FOLLOWER]: Refusing update from remote peer 7bef2a3e691043d78c4315565b15c55c: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260806 00:53:31.076282 13589 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260806 00:53:31.076438 13556 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260806 00:53:31.077205 13591 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, aeaa49fd09c9478a9b5b2a64107268f3 (127.3.98.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } } }
I20260806 00:53:31.077337 12712 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, aeaa49fd09c9478a9b5b2a64107268f3 (127.3.98.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } } }
I20260806 00:53:31.077407 12963 raft_consensus.cc:2932] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, aeaa49fd09c9478a9b5b2a64107268f3 (127.3.98.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } } }
I20260806 00:53:31.078372 13593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } } }
I20260806 00:53:31.078480 13593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:53:31.078511 13589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } } }
I20260806 00:53:31.078593 13589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:31.078579 13591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } } }
I20260806 00:53:31.078616 12903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } } }
I20260806 00:53:31.078744 13575 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7bef2a3e691043d78c4315565b15c55c" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } } }
I20260806 00:53:31.078760 13591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:31.078779 12903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:31.078840 13575 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:53:31.105518 13565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:31.103126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55084 (local address 127.3.98.129:40359)
0806 00:53:31.103191 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:31.103193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:31.103202 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:53:31.103251 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:31.103252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:31.103272 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:31.103337 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:31.103502 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.103971 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.104759 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.104952 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.105015 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:31.105152 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:31.105260 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:31.105323 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:31.105353 (+ 30us) server_negotiation.cc:299] Negotiation successful
0806 00:53:31.105372 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 00:53:31.107496 13308 raft_consensus.cc:1261] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41 [term 1 FOLLOWER]: Refusing update from remote peer 1ad9d673898647c3b6365e895eb1d9a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:31.107540 13482 raft_consensus.cc:1261] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f [term 1 FOLLOWER]: Refusing update from remote peer 1ad9d673898647c3b6365e895eb1d9a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:31.107920 13586 consensus_queue.cc:1035] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:31.108318 13572 consensus_queue.cc:1035] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:31.111546 13595 mvcc.cc:205] Tried to move back new op lower bound from 7315364295093161984 to 7315364294953267200. Current Snapshot: MvccSnapshot[applied={T|T < 7315364295093161984}]
I20260806 00:53:31.112637 13597 mvcc.cc:205] Tried to move back new op lower bound from 7315364295093161984 to 7315364294953267200. Current Snapshot: MvccSnapshot[applied={T|T < 7315364295093161984}]
I20260806 00:53:31.113215 13596 mvcc.cc:205] Tried to move back new op lower bound from 7315364295093161984 to 7315364294953267200. Current Snapshot: MvccSnapshot[applied={T|T < 7315364295093161984}]
I20260806 00:53:31.114601 11897 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:31.114691 11897 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36374:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:31.116499 11897 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7bef2a3e691043d78c4315565b15c55c: Sending DeleteTablet for 3 replicas of tablet 3f021c49c28c4d5a86fbb4160a2b679a
I20260806 00:53:31.116849 13453 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f021c49c28c4d5a86fbb4160a2b679a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:31 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:56776
I20260806 00:53:31.116870 13284 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f021c49c28c4d5a86fbb4160a2b679a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:31 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:37682
I20260806 00:53:31.116861 13108 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f021c49c28c4d5a86fbb4160a2b679a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:31 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:55074
I20260806 00:53:31.117221 13610 tablet_replica.cc:330] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0: stopping tablet replica
I20260806 00:53:31.117331 13610 raft_consensus.cc:2229] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:53:31.117429 13610 raft_consensus.cc:2258] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:31.117595 13614 tablet_replica.cc:330] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f: stopping tablet replica
I20260806 00:53:31.117704 13614 raft_consensus.cc:2229] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:31.117815 13614 raft_consensus.cc:2258] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:31.117884 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 11855
I20260806 00:53:31.117942 13610 ts_tablet_manager.cc:1905] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:31.118280 13614 ts_tablet_manager.cc:1905] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:31.120111 13610 ts_tablet_manager.cc:1918] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:31.120201 13610 log.cc:1196] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-0/wal/wals/3f021c49c28c4d5a86fbb4160a2b679a
I20260806 00:53:31.120326 13614 ts_tablet_manager.cc:1918] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:31.120404 13614 log.cc:1196] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/3f021c49c28c4d5a86fbb4160a2b679a
I20260806 00:53:31.120569 13610 ts_tablet_manager.cc:1939] T 3f021c49c28c4d5a86fbb4160a2b679a P 1ad9d673898647c3b6365e895eb1d9a0: Deleting consensus metadata
I20260806 00:53:31.120729 13614 ts_tablet_manager.cc:1939] T 3f021c49c28c4d5a86fbb4160a2b679a P fc3e44d75413441683e21e65eb13473f: Deleting consensus metadata
I20260806 00:53:31.124657 13609 tablet_replica.cc:330] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41: stopping tablet replica
I20260806 00:53:31.124791 13609 raft_consensus.cc:2229] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:31.124907 13609 raft_consensus.cc:2258] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:31.133020 13609 ts_tablet_manager.cc:1905] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:31.135255 13609 ts_tablet_manager.cc:1918] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:31.135363 13609 log.cc:1196] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/3f021c49c28c4d5a86fbb4160a2b679a
I20260806 00:53:31.135672 13609 ts_tablet_manager.cc:1939] T 3f021c49c28c4d5a86fbb4160a2b679a P 19c13f490efb412195a794a3feb8fb41: Deleting consensus metadata
W20260806 00:53:31.135727 13392 connection.cc:535] server connection from 127.0.0.1:56776 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 00:53:31.135741 13042 connection.cc:535] server connection from 127.0.0.1:55074 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 00:53:31.136348 13225 connection.cc:441] server connection from 127.0.0.1:37682 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37682 (request call id 1) could send its response
I20260806 00:53:31.145401 12772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:31.137643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58378 (local address 127.3.98.189:46075)
0806 00:53:31.137687 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:31.137689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:31.137799 (+ 110us) server_negotiation.cc:407] Connection header received
0806 00:53:31.137929 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:31.137930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:31.137944 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:31.137998 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:31.138734 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.139316 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.140166 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.140522 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.140609 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:31.142288 (+ 1679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:31.142291 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:31.142291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:31.142300 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:31.144100 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:31.144541 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:31.144543 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:31.144543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:31.144608 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:31.144855 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:31.144856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:31.144857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:31.144974 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:31.145079 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:31.145197 (+ 118us) server_negotiation.cc:299] Negotiation successful
0806 00:53:31.145278 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 00:53:31.145715 13005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:31.137570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55538 (local address 127.3.98.188:42877)
0806 00:53:31.137616 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:31.137618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:31.137769 (+ 151us) server_negotiation.cc:407] Connection header received
0806 00:53:31.137895 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:31.137896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:31.137916 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:31.137966 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:31.138941 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.139715 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.140696 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:31.140994 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:31.141079 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:31.142456 (+ 1377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:31.142458 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:31.142458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:31.142466 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:31.144177 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:31.144660 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:31.144661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:31.144662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:31.144736 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:31.144984 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:31.144985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:31.144985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:31.145131 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:31.145205 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:31.145414 (+ 209us) server_negotiation.cc:299] Negotiation successful
0806 00:53:31.145619 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 00:53:32.114112 13627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.113790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.131:59441)
0806 00:53:32.113932 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:32.114052 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":71,"threads_started":1}
I20260806 00:53:32.114507 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.114172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.130:43555)
0806 00:53:32.114381 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:32.114460 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":67,"threads_started":1}
W20260806 00:53:32.114593 13540 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:35873 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
I20260806 00:53:32.114610 13631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.114309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.129:48313)
0806 00:53:32.114478 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:32.114559 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":101,"threads_started":1}
W20260806 00:53:32.114794 13198 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:35873 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
W20260806 00:53:32.114921 13364 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:35873 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
I20260806 00:53:32.616807 13632 raft_consensus.cc:482] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7bef2a3e691043d78c4315565b15c55c)
I20260806 00:53:32.616972 13632 raft_consensus.cc:504] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } }
I20260806 00:53:32.617297 13632 leader_election.cc:288] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bef2a3e691043d78c4315565b15c55c (127.3.98.190:35873), 88f120ad3cc24e3091de960923585ba1 (127.3.98.189:46075)
I20260806 00:53:32.617285 13634 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7bef2a3e691043d78c4315565b15c55c)
I20260806 00:53:32.617487 13634 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } }
I20260806 00:53:32.617703 13635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.617424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:36862)
0806 00:53:32.617573 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:32.617658 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":64,"threads_started":1}
I20260806 00:53:32.617947 13634 leader_election.cc:288] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7bef2a3e691043d78c4315565b15c55c (127.3.98.190:35873), aeaa49fd09c9478a9b5b2a64107268f3 (127.3.98.188:42877)
W20260806 00:53:32.618018 12931 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
I20260806 00:53:32.618167 13643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.617856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:36876)
0806 00:53:32.618044 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:32.618126 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":53,"threads_started":1}
W20260806 00:53:32.618281 12681 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
I20260806 00:53:32.618613 13635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.618518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:36886)
0806 00:53:32.618562 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:32.618586 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 00:53:32.618713 12931 leader_election.cc:334] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7bef2a3e691043d78c4315565b15c55c (127.3.98.190:35873): Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
I20260806 00:53:32.618728 13643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.618629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:36900)
0806 00:53:32.618672 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:32.618703 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 00:53:32.618804 12681 leader_election.cc:334] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7bef2a3e691043d78c4315565b15c55c (127.3.98.190:35873): Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
I20260806 00:53:32.621022 13641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.617542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58386 (local address 127.3.98.189:46075)
0806 00:53:32.617700 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:32.617702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:32.617799 (+ 97us) server_negotiation.cc:407] Connection header received
0806 00:53:32.617901 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:32.617903 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:32.617915 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:32.617972 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:32.618191 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:32.619152 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:32.620216 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:32.620695 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:32.620750 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:32.620760 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:32.620908 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 00:53:32.620939 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":80,"threads_started":1}
I20260806 00:53:32.621038 13640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.617511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:46075 (local address 127.0.0.1:58386)
0806 00:53:32.617716 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:32.617727 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:32.617803 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:32.618031 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:32.618032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:32.618035 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:32.618102 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:32.618104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:32.619279 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:32.619281 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:32.620109 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:32.620112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:32.620765 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:32.620766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:32.620830 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:32.620835 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:53:32.620897 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 00:53:32.620939 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":54,"threads_started":1}
I20260806 00:53:32.621359 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "88f120ad3cc24e3091de960923585ba1" is_pre_election: true
I20260806 00:53:32.621440 13642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.617877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:42877 (local address 127.0.0.1:55548)
0806 00:53:32.618243 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:32.618254 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:32.618314 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:32.618544 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:32.618545 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:32.618548 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:32.618611 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:32.618613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:32.619471 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:32.619472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:32.620376 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:32.620378 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:32.621049 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:32.621050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:32.621260 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:32.621266 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 00:53:32.621331 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 00:53:32.621374 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":43,"threads_started":1}
I20260806 00:53:32.621461 13645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.618048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55548 (local address 127.3.98.188:42877)
0806 00:53:32.618200 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:32.618202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:32.618302 (+ 100us) server_negotiation.cc:407] Connection header received
0806 00:53:32.618403 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:32.618404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:32.618416 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:32.618484 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:32.618708 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:32.619389 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:32.620462 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:32.620972 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:32.621036 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:32.621046 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:32.621339 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 00:53:32.621391 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":45,"threads_started":1}
I20260806 00:53:32.621480 12712 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aeaa49fd09c9478a9b5b2a64107268f3 in term 1.
I20260806 00:53:32.621675 12963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f120ad3cc24e3091de960923585ba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" is_pre_election: true
I20260806 00:53:32.621706 12930 leader_election.cc:302] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88f120ad3cc24e3091de960923585ba1, aeaa49fd09c9478a9b5b2a64107268f3; no voters: 7bef2a3e691043d78c4315565b15c55c
I20260806 00:53:32.621763 12963 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f120ad3cc24e3091de960923585ba1 in term 1.
I20260806 00:53:32.621847 13632 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 00:53:32.621886 13632 raft_consensus.cc:482] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7bef2a3e691043d78c4315565b15c55c)
I20260806 00:53:32.621906 13632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 1 FOLLOWER]: Advancing to term 2
I20260806 00:53:32.621941 12679 leader_election.cc:302] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88f120ad3cc24e3091de960923585ba1, aeaa49fd09c9478a9b5b2a64107268f3; no voters: 7bef2a3e691043d78c4315565b15c55c
I20260806 00:53:32.622071 13634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 00:53:32.622124 13634 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7bef2a3e691043d78c4315565b15c55c)
I20260806 00:53:32.622156 13634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 1 FOLLOWER]: Advancing to term 2
I20260806 00:53:32.622928 13632 raft_consensus.cc:504] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } }
I20260806 00:53:32.622965 13634 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } }
I20260806 00:53:32.623080 13632 leader_election.cc:288] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [CANDIDATE]: Term 2 election: Requested vote from peers 7bef2a3e691043d78c4315565b15c55c (127.3.98.190:35873), 88f120ad3cc24e3091de960923585ba1 (127.3.98.189:46075)
I20260806 00:53:32.623106 13634 leader_election.cc:288] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [CANDIDATE]: Term 2 election: Requested vote from peers 7bef2a3e691043d78c4315565b15c55c (127.3.98.190:35873), aeaa49fd09c9478a9b5b2a64107268f3 (127.3.98.188:42877)
I20260806 00:53:32.623245 12963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f120ad3cc24e3091de960923585ba1" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "aeaa49fd09c9478a9b5b2a64107268f3"
I20260806 00:53:32.623310 13640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.623220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:36920)
0806 00:53:32.623252 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:32.623279 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260806 00:53:32.623323 13642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.623180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:36908)
0806 00:53:32.623271 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:32.623299 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260806 00:53:32.623337 12963 raft_consensus.cc:2379] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88f120ad3cc24e3091de960923585ba1 in current term 2: Already voted for candidate aeaa49fd09c9478a9b5b2a64107268f3 in this term.
I20260806 00:53:32.623587 13640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.623502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:36930)
0806 00:53:32.623536 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:32.623569 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260806 00:53:32.623553 12712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "88f120ad3cc24e3091de960923585ba1"
I20260806 00:53:32.623708 12712 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aeaa49fd09c9478a9b5b2a64107268f3 in current term 2: Already voted for candidate 88f120ad3cc24e3091de960923585ba1 in this term.
W20260806 00:53:32.623693 12931 leader_election.cc:334] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7bef2a3e691043d78c4315565b15c55c (127.3.98.190:35873): Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
I20260806 00:53:32.623876 12930 leader_election.cc:302] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aeaa49fd09c9478a9b5b2a64107268f3; no voters: 7bef2a3e691043d78c4315565b15c55c, 88f120ad3cc24e3091de960923585ba1
I20260806 00:53:32.623999 13642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:32.623895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:36932)
0806 00:53:32.623946 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:32.623977 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 00:53:32.624011 13632 raft_consensus.cc:2726] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260806 00:53:32.624083 12681 leader_election.cc:334] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7bef2a3e691043d78c4315565b15c55c (127.3.98.190:35873): Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
I20260806 00:53:32.624130 12681 leader_election.cc:302] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88f120ad3cc24e3091de960923585ba1; no voters: 7bef2a3e691043d78c4315565b15c55c, aeaa49fd09c9478a9b5b2a64107268f3
I20260806 00:53:32.624208 13634 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260806 00:53:33.115309 13649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:33.115069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.131:49413)
0806 00:53:33.115208 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:33.115249 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260806 00:53:33.115518 13650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:33.115134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.129:40917)
0806 00:53:33.115435 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:33.115471 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":50,"threads_started":1}
I20260806 00:53:33.115590 13652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:33.115199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.130:55601)
0806 00:53:33.115341 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:33.115379 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":77,"threads_started":1}
I20260806 00:53:34.116096 13653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.115814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.131:33107)
0806 00:53:34.115977 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.116032 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":84,"threads_started":1}
I20260806 00:53:34.116127 13654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.115907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.129:53399)
0806 00:53:34.116030 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.116071 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":60,"threads_started":1}
I20260806 00:53:34.116585 13655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.116139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.130:36589)
0806 00:53:34.116302 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.116335 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":49,"threads_started":1}
I20260806 00:53:34.689983 13656 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:34.690086 13656 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } }
I20260806 00:53:34.690325 13656 leader_election.cc:288] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7bef2a3e691043d78c4315565b15c55c (127.3.98.190:35873), aeaa49fd09c9478a9b5b2a64107268f3 (127.3.98.188:42877)
I20260806 00:53:34.690650 12963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f120ad3cc24e3091de960923585ba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" is_pre_election: true
I20260806 00:53:34.690714 13659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.690488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:37244)
0806 00:53:34.690628 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.690673 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":94,"threads_started":1}
I20260806 00:53:34.690766 12963 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88f120ad3cc24e3091de960923585ba1 in term 2.
I20260806 00:53:34.690985 12679 leader_election.cc:302] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88f120ad3cc24e3091de960923585ba1, aeaa49fd09c9478a9b5b2a64107268f3; no voters:
I20260806 00:53:34.691110 13656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260806 00:53:34.691160 13656 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:34.691193 13659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.691074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:37250)
0806 00:53:34.691119 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.691142 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 00:53:34.691192 13656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 2 FOLLOWER]: Advancing to term 3
W20260806 00:53:34.691320 12681 leader_election.cc:334] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7bef2a3e691043d78c4315565b15c55c (127.3.98.190:35873): Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
I20260806 00:53:34.692075 13656 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } }
I20260806 00:53:34.692227 13656 leader_election.cc:288] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [CANDIDATE]: Term 3 election: Requested vote from peers 7bef2a3e691043d78c4315565b15c55c (127.3.98.190:35873), aeaa49fd09c9478a9b5b2a64107268f3 (127.3.98.188:42877)
I20260806 00:53:34.692436 13659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.692316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:37260)
0806 00:53:34.692375 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.692411 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 00:53:34.692402 12963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "88f120ad3cc24e3091de960923585ba1" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "aeaa49fd09c9478a9b5b2a64107268f3"
I20260806 00:53:34.692510 12963 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 2 FOLLOWER]: Advancing to term 3
I20260806 00:53:34.692821 13659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.692740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:37270)
0806 00:53:34.692772 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.692801 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260806 00:53:34.692947 12681 leader_election.cc:334] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7bef2a3e691043d78c4315565b15c55c (127.3.98.190:35873): Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
I20260806 00:53:34.693344 12963 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88f120ad3cc24e3091de960923585ba1 in term 3.
I20260806 00:53:34.693539 12679 leader_election.cc:302] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88f120ad3cc24e3091de960923585ba1, aeaa49fd09c9478a9b5b2a64107268f3; no voters: 7bef2a3e691043d78c4315565b15c55c
I20260806 00:53:34.693671 13656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 00:53:34.693795 13656 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [term 3 LEADER]: Becoming Leader. State: Replica: 88f120ad3cc24e3091de960923585ba1, State: Running, Role: LEADER
I20260806 00:53:34.693884 13656 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } }
I20260806 00:53:34.694341 13661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f120ad3cc24e3091de960923585ba1. Latest consensus state: current_term: 3 leader_uuid: "88f120ad3cc24e3091de960923585ba1" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } } }
I20260806 00:53:34.694458 13661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:34.694674 13664 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:34.695235 13664 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:34.695329 13664 catalog_manager.cc:1259] Loaded cluster ID: 1f988396248f42d78eb9c509cb2ac5c1
I20260806 00:53:34.695366 13664 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:53:34.695566 13664 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:34.695658 13664 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: Loaded TSK: 0
I20260806 00:53:34.695807 13664 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:53:34.727469 12698 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:34.729475 12698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:34.730664 13659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.730525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:37286)
0806 00:53:34.730602 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.730637 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 00:53:34.730684 12963 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [term 3 FOLLOWER]: Refusing update from remote peer 88f120ad3cc24e3091de960923585ba1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260806 00:53:34.730973 13659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.730878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.0.0.1:37300)
0806 00:53:34.730928 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.730951 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 00:53:34.730996 13661 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260806 00:53:34.731132 12681 consensus_peers.cc:487] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 -> Peer 7bef2a3e691043d78c4315565b15c55c (127.3.98.190:35873): Couldn't send request to peer 7bef2a3e691043d78c4315565b15c55c. Status: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 00:53:34.731626 13666 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88f120ad3cc24e3091de960923585ba1. Latest consensus state: current_term: 3 leader_uuid: "88f120ad3cc24e3091de960923585ba1" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } } }
I20260806 00:53:34.731755 13666 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:53:34.732364 13661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "88f120ad3cc24e3091de960923585ba1" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } } }
I20260806 00:53:34.732460 13661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1 [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:34.732738 13666 sys_catalog.cc:455] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "88f120ad3cc24e3091de960923585ba1" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "7bef2a3e691043d78c4315565b15c55c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35873 } } peers { permanent_uuid: "88f120ad3cc24e3091de960923585ba1" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 46075 } attrs { promote: false } } peers { permanent_uuid: "aeaa49fd09c9478a9b5b2a64107268f3" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 42877 } attrs { promote: false } } }
I20260806 00:53:34.732874 13666 sys_catalog.cc:458] T 00000000000000000000000000000000 P aeaa49fd09c9478a9b5b2a64107268f3 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:53:34.738432 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.734692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37692 (local address 127.3.98.130:34691)
0806 00:53:34.734807 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:34.734810 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:34.734833 (+ 23us) server_negotiation.cc:407] Connection header received
0806 00:53:34.734868 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:34.734870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:34.734884 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:34.734978 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:34.735202 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.736005 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.737430 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.738036 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.738125 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:34.738144 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:34.738291 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 00:53:34.738345 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":68,"threads_started":1}
I20260806 00:53:34.738456 13671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.734612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:40359 (local address 127.0.0.1:55088)
0806 00:53:34.735081 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.735090 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:34.735144 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:34.735346 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:34.735346 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:34.735348 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:34.735391 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:34.735393 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.736345 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.736347 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:34.737391 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:34.737395 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.738194 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.738195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:34.738246 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:34.738250 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:34.738301 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 00:53:34.738356 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":2,"thread_start_us":108,"threads_started":1}
I20260806 00:53:34.738773 13678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.734856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55088 (local address 127.3.98.129:40359)
0806 00:53:34.734987 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:34.734989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:34.735134 (+ 145us) server_negotiation.cc:407] Connection header received
0806 00:53:34.735226 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:34.735227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:34.735240 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:34.735297 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:34.735479 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.736262 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.737492 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.738095 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.738175 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:34.738190 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:34.738650 (+ 460us) server_negotiation.cc:299] Negotiation successful
0806 00:53:34.738706 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":71,"threads_started":1}
I20260806 00:53:34.738467 13673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.734570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:34691 (local address 127.0.0.1:37692)
0806 00:53:34.734755 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.734764 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:34.734807 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:34.734982 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:34.734983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:34.734985 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:34.735050 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:34.735052 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.736085 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.736085 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:34.737333 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:34.737336 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.738128 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.738129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:34.738214 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:34.738219 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:53:34.738283 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 00:53:34.738359 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":55,"thread_start_us":76,"threads_started":1}
I20260806 00:53:34.739076 13108 tablet_service.cc:1467] Processing CreateTablet for tablet 61fcbff7bf4341759b59e4aa2cf7aead (DEFAULT_TABLE table=test-table [id=5591f6ffe92142d1a2e6a09941f043d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:34.739192 13659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.734549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:43081 (local address 127.0.0.1:56792)
0806 00:53:34.734655 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.734667 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:34.734720 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:34.735311 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:34.735312 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:34.735313 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:34.735349 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:34.735350 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.736037 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.736039 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:34.737333 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:34.737336 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.738955 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.738957 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:34.739026 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:34.739031 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:53:34.739067 (+ 36us) client_negotiation.cc:240] Negotiation successful
0806 00:53:34.739119 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":53}
I20260806 00:53:34.739269 13108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61fcbff7bf4341759b59e4aa2cf7aead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:34.739466 13284 tablet_service.cc:1467] Processing CreateTablet for tablet 61fcbff7bf4341759b59e4aa2cf7aead (DEFAULT_TABLE table=test-table [id=5591f6ffe92142d1a2e6a09941f043d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:34.739642 13284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61fcbff7bf4341759b59e4aa2cf7aead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:34.739780 13677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.734821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56792 (local address 127.3.98.131:43081)
0806 00:53:34.735171 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:34.735173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:34.735181 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:53:34.735209 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:34.735210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:34.735221 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:34.735412 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:34.735454 (+ 42us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.735945 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.738196 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.738799 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.739492 (+ 693us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:34.739511 (+ 19us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:34.739535 (+ 24us) server_negotiation.cc:299] Negotiation successful
0806 00:53:34.739665 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":67,"threads_started":1}
I20260806 00:53:34.740018 13453 tablet_service.cc:1467] Processing CreateTablet for tablet 61fcbff7bf4341759b59e4aa2cf7aead (DEFAULT_TABLE table=test-table [id=5591f6ffe92142d1a2e6a09941f043d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:34.740159 13453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61fcbff7bf4341759b59e4aa2cf7aead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:34.740828 13679 tablet_bootstrap.cc:492] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0: Bootstrap starting.
I20260806 00:53:34.741181 13679 tablet_bootstrap.cc:654] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:34.741421 13680 tablet_bootstrap.cc:492] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41: Bootstrap starting.
I20260806 00:53:34.741822 13680 tablet_bootstrap.cc:654] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:34.741811 13683 tablet_bootstrap.cc:492] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f: Bootstrap starting.
I20260806 00:53:34.742254 13683 tablet_bootstrap.cc:654] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:34.742494 13679 tablet_bootstrap.cc:492] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0: No bootstrap required, opened a new log
I20260806 00:53:34.742609 13679 ts_tablet_manager.cc:1397] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:53:34.742624 13680 tablet_bootstrap.cc:492] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41: No bootstrap required, opened a new log
I20260806 00:53:34.742674 13680 ts_tablet_manager.cc:1397] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:34.742758 13679 raft_consensus.cc:348] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } }
I20260806 00:53:34.742846 13679 raft_consensus.cc:374] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:34.742872 13679 raft_consensus.cc:729] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ad9d673898647c3b6365e895eb1d9a0, State: Initialized, Role: FOLLOWER
I20260806 00:53:34.742864 13680 raft_consensus.cc:348] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } }
I20260806 00:53:34.742942 13680 raft_consensus.cc:374] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:34.742939 13683 tablet_bootstrap.cc:492] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f: No bootstrap required, opened a new log
I20260806 00:53:34.742947 13679 consensus_queue.cc:260] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } }
I20260806 00:53:34.742983 13680 raft_consensus.cc:729] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19c13f490efb412195a794a3feb8fb41, State: Initialized, Role: FOLLOWER
I20260806 00:53:34.743013 13683 ts_tablet_manager.cc:1397] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:34.743070 13680 consensus_queue.cc:260] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } }
I20260806 00:53:34.743119 13679 ts_tablet_manager.cc:1428] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:34.743150 13683 raft_consensus.cc:348] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } }
I20260806 00:53:34.743242 13683 raft_consensus.cc:374] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:34.743242 13680 ts_tablet_manager.cc:1428] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:34.743273 13683 raft_consensus.cc:729] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc3e44d75413441683e21e65eb13473f, State: Initialized, Role: FOLLOWER
I20260806 00:53:34.743322 13683 consensus_queue.cc:260] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } }
I20260806 00:53:34.743484 13683 ts_tablet_manager.cc:1428] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:34.743917 13689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.743660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.130:49181)
0806 00:53:34.743809 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.743877 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
I20260806 00:53:34.744511 13689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.744283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.130:51613)
0806 00:53:34.744414 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.744443 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260806 00:53:34.744645 13541 heartbeater.cc:503] Master 127.3.98.189:46075 was elected leader, sending a full tablet report...
I20260806 00:53:34.745016 13690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.743782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.129:36587)
0806 00:53:34.744931 (+ 1149us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.744976 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1122,"thread_start_us":88,"threads_started":1}
I20260806 00:53:34.745061 13692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.744121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.131:51385)
0806 00:53:34.744988 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.745026 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":841,"thread_start_us":83,"threads_started":1}
I20260806 00:53:34.745381 13692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.745268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.131:52227)
0806 00:53:34.745301 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.745327 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260806 00:53:34.745405 13200 heartbeater.cc:503] Master 127.3.98.189:46075 was elected leader, sending a full tablet report...
I20260806 00:53:34.745679 13690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.745586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.129:43717)
0806 00:53:34.745619 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.745649 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260806 00:53:34.947888 13688 raft_consensus.cc:482] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:34.948038 13688 raft_consensus.cc:504] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } }
I20260806 00:53:34.948428 13688 leader_election.cc:288] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19c13f490efb412195a794a3feb8fb41 (127.3.98.130:34691), 1ad9d673898647c3b6365e895eb1d9a0 (127.3.98.129:40359)
I20260806 00:53:34.952633 13678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.948837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:42989 (local address 127.3.98.129:40359)
0806 00:53:34.948924 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:34.948926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:34.948936 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:34.949035 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:34.949036 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:34.949047 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:34.949089 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:34.949274 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.949983 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.951620 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.952216 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.952282 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:34.952292 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:34.952497 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 00:53:34.952546 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 00:53:34.952633 13675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.948711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:57845 (local address 127.3.98.130:34691)
0806 00:53:34.948765 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:34.948767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:34.948779 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:53:34.948824 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:34.948826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:34.948840 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:34.948922 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:34.949170 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.949981 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.951620 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.952179 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.952273 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:34.952285 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:34.952519 (+ 234us) server_negotiation.cc:299] Negotiation successful
0806 00:53:34.952561 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 00:53:34.952659 13692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.948634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:34691 (local address 127.3.98.131:57845)
0806 00:53:34.948697 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.948710 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:34.948767 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:34.948939 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:34.948941 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:34.948944 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:34.949035 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:34.949037 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.950079 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.950080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:34.951509 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:34.951513 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.952316 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.952317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:34.952381 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:34.952384 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:34.952445 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 00:53:34.952528 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":89}
I20260806 00:53:34.952672 13693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.948662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:40359 (local address 127.3.98.131:42989)
0806 00:53:34.948876 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.948888 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:34.948931 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:34.949135 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:34.949136 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:34.949138 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:34.949199 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:34.949200 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.950085 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.950085 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:34.951509 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:34.951513 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.952292 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.952294 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:34.952380 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:34.952385 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:53:34.952445 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 00:53:34.952528 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"mutex_wait_us":115,"thread_start_us":127,"threads_started":1}
I20260806 00:53:34.952988 13131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61fcbff7bf4341759b59e4aa2cf7aead" candidate_uuid: "fc3e44d75413441683e21e65eb13473f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad9d673898647c3b6365e895eb1d9a0" is_pre_election: true
I20260806 00:53:34.953142 13131 raft_consensus.cc:2454] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc3e44d75413441683e21e65eb13473f in term 0.
I20260806 00:53:34.953076 13308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61fcbff7bf4341759b59e4aa2cf7aead" candidate_uuid: "fc3e44d75413441683e21e65eb13473f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19c13f490efb412195a794a3feb8fb41" is_pre_election: true
I20260806 00:53:34.953234 13308 raft_consensus.cc:2454] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc3e44d75413441683e21e65eb13473f in term 0.
I20260806 00:53:34.953359 13392 leader_election.cc:302] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ad9d673898647c3b6365e895eb1d9a0, fc3e44d75413441683e21e65eb13473f; no voters:
I20260806 00:53:34.953543 13688 raft_consensus.cc:2781] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:34.953598 13688 raft_consensus.cc:482] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:34.953613 13688 raft_consensus.cc:3037] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:34.954322 13688 raft_consensus.cc:504] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } }
I20260806 00:53:34.954474 13688 leader_election.cc:288] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [CANDIDATE]: Term 1 election: Requested vote from peers 19c13f490efb412195a794a3feb8fb41 (127.3.98.130:34691), 1ad9d673898647c3b6365e895eb1d9a0 (127.3.98.129:40359)
I20260806 00:53:34.954674 13308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61fcbff7bf4341759b59e4aa2cf7aead" candidate_uuid: "fc3e44d75413441683e21e65eb13473f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19c13f490efb412195a794a3feb8fb41"
I20260806 00:53:34.954697 13131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61fcbff7bf4341759b59e4aa2cf7aead" candidate_uuid: "fc3e44d75413441683e21e65eb13473f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ad9d673898647c3b6365e895eb1d9a0"
I20260806 00:53:34.954759 13308 raft_consensus.cc:3037] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:34.954764 13131 raft_consensus.cc:3037] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:34.955420 13308 raft_consensus.cc:2454] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc3e44d75413441683e21e65eb13473f in term 1.
I20260806 00:53:34.955485 13131 raft_consensus.cc:2454] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc3e44d75413441683e21e65eb13473f in term 1.
I20260806 00:53:34.955642 13391 leader_election.cc:302] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19c13f490efb412195a794a3feb8fb41, fc3e44d75413441683e21e65eb13473f; no voters:
I20260806 00:53:34.955730 13688 raft_consensus.cc:2781] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:34.955900 13688 raft_consensus.cc:686] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [term 1 LEADER]: Becoming Leader. State: Replica: fc3e44d75413441683e21e65eb13473f, State: Running, Role: LEADER
I20260806 00:53:34.955983 13688 consensus_queue.cc:237] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } }
I20260806 00:53:34.956357 13693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.956203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.131:40417)
0806 00:53:34.956259 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.956320 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 00:53:34.956918 12696 catalog_manager.cc:5495] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f reported cstate change: term changed from 0 to 1, leader changed from <none> to fc3e44d75413441683e21e65eb13473f (127.3.98.131). New cstate: current_term: 1 leader_uuid: "fc3e44d75413441683e21e65eb13473f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc3e44d75413441683e21e65eb13473f" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 43081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 } health_report { overall_health: UNKNOWN } } }
I20260806 00:53:34.965425 13677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.962968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56798 (local address 127.3.98.131:43081)
0806 00:53:34.963034 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:34.963036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:34.963045 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:53:34.963077 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:34.963077 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:34.963101 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:34.963177 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:34.963321 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.963820 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.964645 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:34.964839 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:34.964912 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:34.965087 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:34.965198 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:34.965278 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:34.965326 (+ 48us) server_negotiation.cc:299] Negotiation successful
0806 00:53:34.965346 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 00:53:34.966687 13308 raft_consensus.cc:1261] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41 [term 1 FOLLOWER]: Refusing update from remote peer fc3e44d75413441683e21e65eb13473f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:34.966872 13131 raft_consensus.cc:1261] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0 [term 1 FOLLOWER]: Refusing update from remote peer fc3e44d75413441683e21e65eb13473f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:34.966975 13688 consensus_queue.cc:1035] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [LEADER]: Connected to new peer: Peer: permanent_uuid: "19c13f490efb412195a794a3feb8fb41" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 34691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:34.967195 13688 consensus_queue.cc:1035] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ad9d673898647c3b6365e895eb1d9a0" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 40359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:34.967527 13365 heartbeater.cc:503] Master 127.3.98.189:46075 was elected leader, sending a full tablet report...
I20260806 00:53:34.967665 13689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.967567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.130:34593)
0806 00:53:34.967612 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.967639 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260806 00:53:34.968501 13690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.968365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.129:39183)
0806 00:53:34.968407 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.968431 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260806 00:53:34.969275 13693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.969085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.131:43433)
0806 00:53:34.969221 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.969250 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260806 00:53:34.970202 13693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.969921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.131:34851)
0806 00:53:34.970146 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.970176 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210}
I20260806 00:53:34.971583 12698 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:34.971657 13689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.971502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.130:40061)
0806 00:53:34.971595 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.971628 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 00:53:34.971686 12698 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:34.972334 13690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:34.972229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35873 (local address 127.3.98.129:55433)
0806 00:53:34.972274 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:34.972303 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:35873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 00:53:34.973166 12698 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 88f120ad3cc24e3091de960923585ba1: Sending DeleteTablet for 3 replicas of tablet 61fcbff7bf4341759b59e4aa2cf7aead
I20260806 00:53:34.973376 13108 tablet_service.cc:1514] Processing DeleteTablet for tablet 61fcbff7bf4341759b59e4aa2cf7aead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:34 UTC) from {username='oryx', principal='oryx/127.3.98.189@KRBTEST.COM'} at 127.0.0.1:55088
I20260806 00:53:34.973495 13453 tablet_service.cc:1514] Processing DeleteTablet for tablet 61fcbff7bf4341759b59e4aa2cf7aead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:34 UTC) from {username='oryx', principal='oryx/127.3.98.189@KRBTEST.COM'} at 127.0.0.1:56792
I20260806 00:53:34.973626 13108 tablet_service.cc:1514] Processing DeleteTablet for tablet 61fcbff7bf4341759b59e4aa2cf7aead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:34 UTC) from {username='oryx', principal='oryx/127.3.98.189@KRBTEST.COM'} at 127.0.0.1:55088
I20260806 00:53:34.973742 13713 tablet_replica.cc:330] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0: stopping tablet replica
I20260806 00:53:34.973839 13713 raft_consensus.cc:2229] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:34.973946 13713 raft_consensus.cc:2258] T 61fcbff7bf4341759b59e4aa2cf7aead P 1ad9d673898647c3b6365e895eb1d9a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:34.973986 13284 tablet_service.cc:1514] Processing DeleteTablet for tablet 61fcbff7bf4341759b59e4aa2cf7aead with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:34 UTC) from {username='oryx', principal='oryx/127.3.98.189@KRBTEST.COM'} at 127.0.0.1:37692
I20260806 00:53:34.974226 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 13023
I20260806 00:53:34.989427 13715 tablet_replica.cc:330] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41: stopping tablet replica
I20260806 00:53:34.989643 13715 raft_consensus.cc:2229] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:34.989859 13715 raft_consensus.cc:2258] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:34.992776 13715 ts_tablet_manager.cc:1905] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:34.997778 13715 ts_tablet_manager.cc:1918] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:34.997972 13715 log.cc:1196] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/61fcbff7bf4341759b59e4aa2cf7aead
I20260806 00:53:34.974164 13714 tablet_replica.cc:330] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f: stopping tablet replica
I20260806 00:53:34.998485 13714 raft_consensus.cc:2229] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:53:34.998600 13715 ts_tablet_manager.cc:1939] T 61fcbff7bf4341759b59e4aa2cf7aead P 19c13f490efb412195a794a3feb8fb41: Deleting consensus metadata
I20260806 00:53:34.998621 13714 raft_consensus.cc:2258] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:34.999195 12679 catalog_manager.cc:4841] TS 19c13f490efb412195a794a3feb8fb41 (127.3.98.130:34691): tablet 61fcbff7bf4341759b59e4aa2cf7aead (table test-table [id=5591f6ffe92142d1a2e6a09941f043d7]) successfully deleted
I20260806 00:53:35.004822 13714 ts_tablet_manager.cc:1905] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:35.006304 13714 ts_tablet_manager.cc:1918] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:35.006390 13714 log.cc:1196] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/61fcbff7bf4341759b59e4aa2cf7aead
I20260806 00:53:35.006682 13714 ts_tablet_manager.cc:1939] T 61fcbff7bf4341759b59e4aa2cf7aead P fc3e44d75413441683e21e65eb13473f: Deleting consensus metadata
I20260806 00:53:35.007099 12677 catalog_manager.cc:4841] TS fc3e44d75413441683e21e65eb13473f (127.3.98.131:43081): tablet 61fcbff7bf4341759b59e4aa2cf7aead (table test-table [id=5591f6ffe92142d1a2e6a09941f043d7]) successfully deleted
W20260806 00:53:35.007385 13659 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:35.007031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:40359 (local address 127.0.0.1:55094)
0806 00:53:35.007091 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:35.007103 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:35.007143 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:35.007341 (+ 198us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:40359: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":40}
W20260806 00:53:35.007561 12680 catalog_manager.cc:4584] TS 1ad9d673898647c3b6365e895eb1d9a0 (127.3.98.129:40359): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 61fcbff7bf4341759b59e4aa2cf7aead: Network error: Client connection negotiation failed: client connection to 127.3.98.129:40359: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 00:53:35.007689 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 13205
I20260806 00:53:35.018103 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 13372
I20260806 00:53:35.031984 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 12521
I20260806 00:53:35.042256 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 12776
2026-08-06T00:53:35Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7534 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:35 dist-test-slave-44d2 krb5kdc[13719](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:35 dist-test-slave-44d2 krb5kdc[13719](info): set up 2 sockets
Aug 06 00:53:35 dist-test-slave-44d2 krb5kdc[13719](info): commencing operation
krb5kdc: starting...
W20260806 00:53:36.254568 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:36 dist-test-slave-44d2 krb5kdc[13719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:36Z Disabled control of system clock
WARNING: no policy specified for oryx/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.190.keytab.
Entry for principal oryx/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.190.keytab.
I20260806 00:53:36.399091 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:40109
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.190.keytab
--principal=oryx/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:35787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:40109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:36.482973 13735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:36.483183 13735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:36.483206 13735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:36.484284 13735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:36.484321 13735 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 00:53:36.484334 13735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:36.484347 13735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:36.484359 13735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:36.484371 13735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:36.485837 13735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:35787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:40109
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.190.keytab
--principal=oryx/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:40109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:36.486033 13735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:36.486215 13735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:36.491323 13743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:36.491364 13735 server_base.cc:1034] running on GCE node
W20260806 00:53:36.491313 13746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:36.491312 13744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:36.491923 13735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:36.492223 13735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:36.493404 13735 hybrid_clock.cc:648] HybridClock initialized: now 1785977616493388 us; error 28 us; skew 500 ppm
Aug 06 00:53:36 dist-test-slave-44d2 krb5kdc[13719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977616, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:36.495890 13735 init.cc:377] Logged in from keytab as oryx/127.3.98.190@KRBTEST.COM (short username oryx)
I20260806 00:53:36.496397 13735 webserver.cc:460] Webserver started at http://127.3.98.190:39889/ using document root <none> and password file <none>
I20260806 00:53:36.496666 13735 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:36.496737 13735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:36.496888 13735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:36.498091 13735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "f7edc46b6a0d42479cf74ce270e4ecda"
format_stamp: "Formatted at 2026-08-06 00:53:36 on dist-test-slave-44d2"
server_key: "acbe34c9261706bb46805eeeaecead45"
server_key_iv: "410fa6d3d776c3d99021133b8f8cc9d5"
server_key_version: "encryptionkey@0"
I20260806 00:53:36.498481 13735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "f7edc46b6a0d42479cf74ce270e4ecda"
format_stamp: "Formatted at 2026-08-06 00:53:36 on dist-test-slave-44d2"
server_key: "acbe34c9261706bb46805eeeaecead45"
server_key_iv: "410fa6d3d776c3d99021133b8f8cc9d5"
server_key_version: "encryptionkey@0"
I20260806 00:53:36.499866 13735 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:36.500669 13754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:36.500857 13735 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:36.500962 13735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "f7edc46b6a0d42479cf74ce270e4ecda"
format_stamp: "Formatted at 2026-08-06 00:53:36 on dist-test-slave-44d2"
server_key: "acbe34c9261706bb46805eeeaecead45"
server_key_iv: "410fa6d3d776c3d99021133b8f8cc9d5"
server_key_version: "encryptionkey@0"
I20260806 00:53:36.501048 13735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:36.512633 13735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:36.514762 13735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:36.514933 13735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:36.519927 13735 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:40109
I20260806 00:53:36.519989 13837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:40109 every 8 connection(s)
I20260806 00:53:36.520313 13735 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:36.521003 13838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:36.523298 13838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda: Bootstrap starting.
I20260806 00:53:36.523916 13838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:36.524283 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 13735
I20260806 00:53:36.524314 13838 log.cc:824] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:36.524390 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:36.524632 3466 external_mini_cluster.cc:1428] Setting key 86941ee30c3d2c916caa74c484e4876f
I20260806 00:53:36.525082 13838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda: No bootstrap required, opened a new log
I20260806 00:53:36.527283 13838 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7edc46b6a0d42479cf74ce270e4ecda" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40109 } }
I20260806 00:53:36.527446 13838 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:36.527513 13838 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7edc46b6a0d42479cf74ce270e4ecda, State: Initialized, Role: FOLLOWER
I20260806 00:53:36.527704 13838 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7edc46b6a0d42479cf74ce270e4ecda" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40109 } }
I20260806 00:53:36.527804 13838 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:36.527849 13838 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:36.527897 13838 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:36.528548 13838 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7edc46b6a0d42479cf74ce270e4ecda" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40109 } }
I20260806 00:53:36.528676 13838 leader_election.cc:302] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7edc46b6a0d42479cf74ce270e4ecda; no voters:
I20260806 00:53:36.528854 13838 leader_election.cc:288] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:36.528903 13844 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:36.529111 13844 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [term 1 LEADER]: Becoming Leader. State: Replica: f7edc46b6a0d42479cf74ce270e4ecda, State: Running, Role: LEADER
I20260806 00:53:36.529129 13838 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:36.529290 13844 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7edc46b6a0d42479cf74ce270e4ecda" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40109 } }
I20260806 00:53:36.529592 13844 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7edc46b6a0d42479cf74ce270e4ecda. Latest consensus state: current_term: 1 leader_uuid: "f7edc46b6a0d42479cf74ce270e4ecda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7edc46b6a0d42479cf74ce270e4ecda" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40109 } } }
I20260806 00:53:36.529868 13844 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:36.529793 13845 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7edc46b6a0d42479cf74ce270e4ecda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7edc46b6a0d42479cf74ce270e4ecda" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40109 } } }
I20260806 00:53:36.531010 13845 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda [sys.catalog]: This master's current role is: LEADER
W20260806 00:53:36.531158 13861 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 00:53:36.531230 13861 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:53:36.531281 13862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:36.531451 13862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:36.533159 13862 catalog_manager.cc:1347] Generated new cluster ID: f3ab4464d66347d5b568d48364a1d5ee
I20260806 00:53:36.533218 13862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:53:36 dist-test-slave-44d2 krb5kdc[13719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
I20260806 00:53:36.537729 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:36.525197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53292 (local address 127.3.98.190:40109)
0806 00:53:36.525394 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:36.525401 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:36.525426 (+ 25us) server_negotiation.cc:407] Connection header received
0806 00:53:36.527269 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:36.527275 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:36.527322 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:36.527472 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:36.528254 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.529670 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.530909 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.531529 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.531638 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:36.534337 (+ 2699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:36.534341 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:36.534342 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:36.534354 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:36.536141 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:36.536559 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:36.536562 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:36.536563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:36.536679 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:36.536907 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:36.536908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:36.536908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:36.537149 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:36.537330 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:36.537401 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 00:53:36.537549 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":87,"threads_started":1}
I20260806 00:53:36.544618 13862 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:36.545236 13862 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:36.548496 13862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda: Generated new TSK 0
I20260806 00:53:36.548682 13862 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab.
Entry for principal oryx/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab.
I20260806 00:53:36.581796 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:40109
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab
--principal=oryx/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:35787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:36.680264 13868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:36.680490 13868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:36.680562 13868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:36.681821 13868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:36.681881 13868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:36.681916 13868 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 00:53:36.681967 13868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:36.683544 13868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:35787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab
--principal=oryx/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.98.190:40109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:36.683804 13868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:36.684036 13868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:36.689924 13874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:36.689909 13875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:36.690024 13868 server_base.cc:1034] running on GCE node
W20260806 00:53:36.689910 13877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:36.690418 13868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:36.690675 13868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:36.691856 13868 hybrid_clock.cc:648] HybridClock initialized: now 1785977616691826 us; error 41 us; skew 500 ppm
Aug 06 00:53:36 dist-test-slave-44d2 krb5kdc[13719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977616, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:36.694566 13868 init.cc:377] Logged in from keytab as oryx/127.3.98.129@KRBTEST.COM (short username oryx)
I20260806 00:53:36.694993 13868 webserver.cc:460] Webserver started at http://127.3.98.129:38333/ using document root <none> and password file <none>
I20260806 00:53:36.695235 13868 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:36.695305 13868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:36.695461 13868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:36.696583 13868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "c56298a9b5904309bcccc8eba2c2fd54"
format_stamp: "Formatted at 2026-08-06 00:53:36 on dist-test-slave-44d2"
server_key: "d77b334ddc13571e97674e25054fb94b"
server_key_iv: "b646eac7e601d1ee4b1a9537d44ee1f0"
server_key_version: "encryptionkey@0"
I20260806 00:53:36.696974 13868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "c56298a9b5904309bcccc8eba2c2fd54"
format_stamp: "Formatted at 2026-08-06 00:53:36 on dist-test-slave-44d2"
server_key: "d77b334ddc13571e97674e25054fb94b"
server_key_iv: "b646eac7e601d1ee4b1a9537d44ee1f0"
server_key_version: "encryptionkey@0"
I20260806 00:53:36.698840 13868 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260806 00:53:36.699635 13885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:36.699826 13868 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:36.699939 13868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "c56298a9b5904309bcccc8eba2c2fd54"
format_stamp: "Formatted at 2026-08-06 00:53:36 on dist-test-slave-44d2"
server_key: "d77b334ddc13571e97674e25054fb94b"
server_key_iv: "b646eac7e601d1ee4b1a9537d44ee1f0"
server_key_version: "encryptionkey@0"
I20260806 00:53:36.700017 13868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:36.713194 13868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:36.715423 13868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:36.715646 13868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:36.716302 13868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:36.716383 13868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:36.716435 13868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:36.716506 13868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 00:53:36 dist-test-slave-44d2 krb5kdc[13719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977616, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
I20260806 00:53:36.725777 13868 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:44609
I20260806 00:53:36.725806 14035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:44609 every 8 connection(s)
I20260806 00:53:36.726329 13868 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:53:36.728399 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:36.716808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:51665 (local address 127.3.98.190:40109)
0806 00:53:36.716896 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:36.716898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:36.717224 (+ 326us) server_negotiation.cc:407] Connection header received
0806 00:53:36.718134 (+ 910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:36.718136 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:36.718147 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:36.718194 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:36.719298 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.719826 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.721726 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.721973 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.722064 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:36.724920 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:36.724922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:36.724922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:36.724932 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:36.727059 (+ 2127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:36.727455 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:36.727456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:36.727456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:36.727552 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:36.727788 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:36.727789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:36.727789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:36.727919 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:36.727983 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:36.728231 (+ 248us) server_negotiation.cc:299] Negotiation successful
0806 00:53:36.728318 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 00:53:36.728533 13896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:36.716786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:40109 (local address 127.3.98.129:51665)
0806 00:53:36.717043 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:36.717095 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:36.718003 (+ 908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:36.718288 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:36.718294 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:36.718800 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:36.719145 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:36.719153 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.719937 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.719939 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:36.721619 (+ 1680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:36.721624 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.722076 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.722077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:36.722248 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:36.722822 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:36.722831 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:36.724814 (+ 1983us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:36.727150 (+ 2336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:36.727157 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:36.727159 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:36.727380 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:36.727621 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:36.727622 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:36.727622 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:36.727724 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:36.727980 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:36.727985 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:36.728100 (+ 115us) client_negotiation.cc:769] Sending connection context
0806 00:53:36.728192 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 00:53:36.728318 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":115,"threads_started":1}
I20260806 00:53:36.728756 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 13868
I20260806 00:53:36.728873 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:36.729106 3466 external_mini_cluster.cc:1428] Setting key fd511967f6397d34bd4d640f2f659361
I20260806 00:53:36.729233 14036 heartbeater.cc:347] Connected to a master server at 127.3.98.190:40109
I20260806 00:53:36.729379 14036 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:36.729609 14036 heartbeater.cc:511] Master 127.3.98.190:40109 requested a full tablet report, sending...
I20260806 00:53:36.730194 13775 ts_manager.cc:194] Registered new tserver with Master: c56298a9b5904309bcccc8eba2c2fd54 (127.3.98.129:44609)
I20260806 00:53:36.731110 13775 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:51665
I20260806 00:53:36.737700 14043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:36.730421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:40109 (local address 127.3.98.129:39969)
0806 00:53:36.730565 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:36.730586 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:36.730643 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:36.730785 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:36.730786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:36.731003 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:36.731082 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:36.731084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.731979 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.731981 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:36.733087 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:36.733091 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.733534 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.733535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:36.733620 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:36.734146 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:36.734151 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:36.734503 (+ 352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:36.736710 (+ 2207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:36.736711 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:36.736711 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:36.736883 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:36.737119 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:36.737120 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:36.737120 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:36.737176 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:36.737469 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:36.737470 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:36.737504 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 00:53:36.737553 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 00:53:36.737634 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
I20260806 00:53:36.737802 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:36.730499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:39969 (local address 127.3.98.190:40109)
0806 00:53:36.730545 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:36.730547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:36.730652 (+ 105us) server_negotiation.cc:407] Connection header received
0806 00:53:36.730684 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:36.730685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:36.730696 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:36.730780 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:36.731172 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.731877 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.733234 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.733445 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.733507 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:36.734637 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:36.734640 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:36.734640 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:36.734648 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:36.736622 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:36.736973 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:36.736975 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:36.736975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:36.737042 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:36.737243 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:36.737244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:36.737245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:36.737395 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:36.737466 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:36.737607 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 00:53:36.737697 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for oryx/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab.
Entry for principal oryx/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab.
I20260806 00:53:36.759488 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:40109
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab
--principal=oryx/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:35787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:36.849154 14046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:36.849377 14046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:36.849406 14046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:36.850647 14046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:36.850688 14046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:36.850711 14046 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 00:53:36.850730 14046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:36.852365 14046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:35787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab
--principal=oryx/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.98.190:40109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:36.852658 14046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:36.852902 14046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:36.858286 14057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:36.858283 14058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:36.858279 14061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:36.858453 14046 server_base.cc:1034] running on GCE node
I20260806 00:53:36.858783 14046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:36.859025 14046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:36.860169 14046 hybrid_clock.cc:648] HybridClock initialized: now 1785977616860158 us; error 32 us; skew 500 ppm
Aug 06 00:53:36 dist-test-slave-44d2 krb5kdc[13719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977616, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:36.862913 14046 init.cc:377] Logged in from keytab as oryx/127.3.98.130@KRBTEST.COM (short username oryx)
I20260806 00:53:36.863339 14046 webserver.cc:460] Webserver started at http://127.3.98.130:43951/ using document root <none> and password file <none>
I20260806 00:53:36.863559 14046 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:36.863627 14046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:36.863729 14046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:36.864931 14046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "b7410f030c414b53a57f3bb402b093da"
format_stamp: "Formatted at 2026-08-06 00:53:36 on dist-test-slave-44d2"
server_key: "3da400d0d55ed005acef0d712bf8c6f1"
server_key_iv: "7d1e50f43ec251fd96572b8f33b05972"
server_key_version: "encryptionkey@0"
I20260806 00:53:36.865248 14046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "b7410f030c414b53a57f3bb402b093da"
format_stamp: "Formatted at 2026-08-06 00:53:36 on dist-test-slave-44d2"
server_key: "3da400d0d55ed005acef0d712bf8c6f1"
server_key_iv: "7d1e50f43ec251fd96572b8f33b05972"
server_key_version: "encryptionkey@0"
I20260806 00:53:36.866680 14046 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:53:36.867447 14069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:36.867650 14046 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:36.867738 14046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "b7410f030c414b53a57f3bb402b093da"
format_stamp: "Formatted at 2026-08-06 00:53:36 on dist-test-slave-44d2"
server_key: "3da400d0d55ed005acef0d712bf8c6f1"
server_key_iv: "7d1e50f43ec251fd96572b8f33b05972"
server_key_version: "encryptionkey@0"
I20260806 00:53:36.867794 14046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:36.877921 14046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:36.879830 14046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:36.879941 14046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:36.880385 14046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:36.880470 14046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:36.880563 14046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:36.880612 14046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:36.887548 14046 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:38141
I20260806 00:53:36.887639 14215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:38141 every 8 connection(s)
Aug 06 00:53:36 dist-test-slave-44d2 krb5kdc[13719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977616, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
I20260806 00:53:36.887943 14046 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:36.890898 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:36.880984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:44339 (local address 127.3.98.190:40109)
0806 00:53:36.881061 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:36.881064 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:36.881232 (+ 168us) server_negotiation.cc:407] Connection header received
0806 00:53:36.881893 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:36.881895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:36.881908 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:36.881965 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:36.882800 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.883657 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.885405 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.885750 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.885837 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:36.888550 (+ 2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:36.888552 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:36.888552 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:36.888560 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:36.889745 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:36.890121 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:36.890122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:36.890122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:36.890175 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:36.890355 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:36.890355 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:36.890355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:36.890459 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:36.890510 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:36.890768 (+ 258us) server_negotiation.cc:299] Negotiation successful
0806 00:53:36.890835 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 00:53:36.891053 14079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:36.880935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:40109 (local address 127.3.98.130:44339)
0806 00:53:36.881114 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:36.881155 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:36.881761 (+ 606us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:36.882034 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:36.882038 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:36.882387 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:36.882682 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:36.882688 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.883777 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.883778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:36.885300 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:36.885304 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.885846 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.885847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:36.885971 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:36.886530 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:36.886540 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:36.888417 (+ 1877us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:36.889817 (+ 1400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:36.889824 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:36.889826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:36.890048 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:36.890218 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:36.890218 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:36.890218 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:36.890304 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:36.890543 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:36.890549 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:36.890656 (+ 107us) client_negotiation.cc:769] Sending connection context
0806 00:53:36.890739 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 00:53:36.890866 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":109,"threads_started":1}
I20260806 00:53:36.891541 14217 heartbeater.cc:347] Connected to a master server at 127.3.98.190:40109
I20260806 00:53:36.891629 14217 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:36.891813 14217 heartbeater.cc:511] Master 127.3.98.190:40109 requested a full tablet report, sending...
I20260806 00:53:36.892192 13774 ts_manager.cc:194] Registered new tserver with Master: b7410f030c414b53a57f3bb402b093da (127.3.98.130:38141)
I20260806 00:53:36.892674 13774 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:44339
I20260806 00:53:36.895254 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 14046
I20260806 00:53:36.895376 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:36.895584 3466 external_mini_cluster.cc:1428] Setting key 178e2afaff74fa2f86c5275b01d2ecdb
I20260806 00:53:36.898597 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:36.892711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:41039 (local address 127.3.98.190:40109)
0806 00:53:36.892853 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:36.892854 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:36.892862 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:53:36.892881 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:36.892882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:36.892891 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:36.892951 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:36.893312 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.893771 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.894408 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.894600 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.894653 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:36.895646 (+ 993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:36.895648 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:36.895648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:36.895656 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:36.897359 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:36.897689 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:36.897690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:36.897691 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:36.897756 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:36.897937 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:36.897937 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:36.897938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:36.898137 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:36.898213 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:36.898476 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 00:53:36.898540 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260806 00:53:36.898696 14227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:36.892650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:40109 (local address 127.3.98.130:41039)
0806 00:53:36.892770 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:36.892787 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:36.892834 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:36.892953 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:36.892954 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:36.893174 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:36.893235 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:36.893237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.893861 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.893862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:36.894334 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:36.894336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:36.894667 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:36.894668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:36.894714 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:36.895151 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:36.895156 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:36.895564 (+ 408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:36.897444 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:36.897445 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:36.897445 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:36.897617 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:36.897820 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:36.897821 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:36.897821 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:36.897875 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:36.898262 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:36.898264 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:36.898330 (+ 66us) client_negotiation.cc:769] Sending connection context
0806 00:53:36.898429 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 00:53:36.898556 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":67,"threads_started":1}
WARNING: no policy specified for oryx/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab.
Entry for principal oryx/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab.
I20260806 00:53:36.923851 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:40109
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab
--principal=oryx/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:35787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:37.007931 14234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:37.008138 14234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:37.008162 14234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:37.009277 14234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:37.009316 14234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:37.009337 14234 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 00:53:37.009354 14234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:37.010821 14234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:35787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab
--principal=oryx/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.98.190:40109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:37.011019 14234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:37.011205 14234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:37.016202 14240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:37.016297 14244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:37.016191 14242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:37.016691 14234 server_base.cc:1034] running on GCE node
I20260806 00:53:37.016917 14234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:37.017153 14234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:37.018342 14234 hybrid_clock.cc:648] HybridClock initialized: now 1785977617018332 us; error 47 us; skew 500 ppm
Aug 06 00:53:37 dist-test-slave-44d2 krb5kdc[13719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977617, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:37.021320 14234 init.cc:377] Logged in from keytab as oryx/127.3.98.131@KRBTEST.COM (short username oryx)
I20260806 00:53:37.021837 14234 webserver.cc:460] Webserver started at http://127.3.98.131:43187/ using document root <none> and password file <none>
I20260806 00:53:37.022145 14234 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:37.022228 14234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:37.022418 14234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:37.023659 14234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0"
format_stamp: "Formatted at 2026-08-06 00:53:37 on dist-test-slave-44d2"
server_key: "2806625c727bae4ae6e0649ec89df2d4"
server_key_iv: "81842b5cb644d9eba2cd90646e72211d"
server_key_version: "encryptionkey@0"
I20260806 00:53:37.024056 14234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0"
format_stamp: "Formatted at 2026-08-06 00:53:37 on dist-test-slave-44d2"
server_key: "2806625c727bae4ae6e0649ec89df2d4"
server_key_iv: "81842b5cb644d9eba2cd90646e72211d"
server_key_version: "encryptionkey@0"
I20260806 00:53:37.025673 14234 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260806 00:53:37.026556 14255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:37.026757 14234 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:37.026877 14234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0"
format_stamp: "Formatted at 2026-08-06 00:53:37 on dist-test-slave-44d2"
server_key: "2806625c727bae4ae6e0649ec89df2d4"
server_key_iv: "81842b5cb644d9eba2cd90646e72211d"
server_key_version: "encryptionkey@0"
I20260806 00:53:37.026959 14234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:37.039785 14234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:37.042339 14234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:37.042516 14234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:37.043073 14234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:37.043145 14234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:37.043213 14234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:37.043246 14234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 00:53:37 dist-test-slave-44d2 krb5kdc[13719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977617, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
I20260806 00:53:37.051450 14234 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:37263
I20260806 00:53:37.051812 14413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:37263 every 8 connection(s)
I20260806 00:53:37.051945 14234 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:37.054090 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.043694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:56971 (local address 127.3.98.190:40109)
0806 00:53:37.043772 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.043775 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.043979 (+ 204us) server_negotiation.cc:407] Connection header received
0806 00:53:37.044457 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.044458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.044475 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.044593 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:37.045453 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.046271 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.047849 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.048186 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.048275 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.051112 (+ 2837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:37.051113 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:37.051113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:37.051136 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:37.052842 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:37.053310 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:37.053311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:37.053311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:37.053364 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:37.053587 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:37.053588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:37.053588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:37.053693 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:37.053744 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.053949 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.054014 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 00:53:37.054268 14270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.043653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:40109 (local address 127.3.98.131:56971)
0806 00:53:37.043840 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:37.043880 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:37.044354 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:37.044701 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:37.044705 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:37.045053 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:37.045340 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.045346 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.046392 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.046393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.047747 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.047751 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.048396 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.048397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.048609 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.049171 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:37.049185 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:37.051005 (+ 1820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:37.052925 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:37.052931 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:37.052933 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:37.053236 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:37.053427 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:37.053427 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:37.053428 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:37.053528 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:37.053736 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:37.053739 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:37.053848 (+ 109us) client_negotiation.cc:769] Sending connection context
0806 00:53:37.053935 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 00:53:37.054068 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":95,"threads_started":1}
I20260806 00:53:37.054826 14414 heartbeater.cc:347] Connected to a master server at 127.3.98.190:40109
I20260806 00:53:37.054914 14414 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:37.055096 14414 heartbeater.cc:511] Master 127.3.98.190:40109 requested a full tablet report, sending...
I20260806 00:53:37.055522 13775 ts_manager.cc:194] Registered new tserver with Master: c2dd4a94f1c24ff19ed13e78db71d2b0 (127.3.98.131:37263)
I20260806 00:53:37.056033 13775 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:56971
I20260806 00:53:37.059660 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 14234
I20260806 00:53:37.059777 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:37.059979 3466 external_mini_cluster.cc:1428] Setting key 022c487658518460ccca4eb4e2b7d8fe
I20260806 00:53:37.061153 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:53:37.061990 14421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.055959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:40109 (local address 127.3.98.131:33943)
0806 00:53:37.056082 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:37.056094 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:37.056158 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:37.056286 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:37.056287 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:37.056521 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:37.056617 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.056620 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.057271 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.057272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.057753 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.057755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.058082 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.058083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.058130 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.058496 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:37.058500 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:37.058779 (+ 279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:37.060787 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:37.060788 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:37.060789 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:37.061026 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:37.061255 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:37.061255 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:37.061256 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:37.061325 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:37.061610 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:37.061612 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:37.061664 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 00:53:37.061752 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 00:53:37.061875 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":71,"threads_started":1}
I20260806 00:53:37.062052 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.056033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:33943 (local address 127.3.98.190:40109)
0806 00:53:37.056094 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.056097 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.056209 (+ 112us) server_negotiation.cc:407] Connection header received
0806 00:53:37.056228 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.056229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.056238 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.056283 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:37.056724 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.057171 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.057826 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.058012 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.058066 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.058856 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:37.058857 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:37.058857 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:37.058863 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:37.060705 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:37.061106 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:37.061107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:37.061107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:37.061174 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:37.061402 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:37.061403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:37.061404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:37.061533 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:37.061608 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.061785 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.061951 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
Aug 06 00:53:37 dist-test-slave-44d2 krb5kdc[13719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977617, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 00:53:37 dist-test-slave-44d2 krb5kdc[13719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:37 dist-test-slave-44d2 krb5kdc[13719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 00:53:37.085479 13843 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:37.079598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53294 (local address 127.3.98.190:40109)
0806 00:53:37.079672 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.079674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.079684 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:37.079747 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.079748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.079759 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.079818 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:37.080424 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.081092 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.081867 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.082164 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.082227 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.085378 (+ 3151us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53294: BlockingRecv error: recv got EOF from 127.0.0.1:53294 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 06 00:53:37 dist-test-slave-44d2 krb5kdc[13719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977617, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
I20260806 00:53:37.092707 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.086225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53302 (local address 127.3.98.190:40109)
0806 00:53:37.086282 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.086283 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.086345 (+ 62us) server_negotiation.cc:407] Connection header received
0806 00:53:37.086382 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.086382 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.086390 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.086440 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:37.086862 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.087319 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.087948 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.088124 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.088180 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.090260 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:37.090261 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:37.090262 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:37.090268 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:37.091447 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:37.091846 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:37.091847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:37.091848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:37.091908 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:37.092111 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:37.092112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:37.092112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:37.092225 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:37.092329 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.092448 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.092554 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 00:53:37.094251 13775 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53302:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:37.095913 13775 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:37.102697 14445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.098445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54242 (local address 127.3.98.131:37263)
0806 00:53:37.098675 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.098680 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.098689 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:53:37.098745 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.098746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.098760 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.098851 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:37.099043 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.099943 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.101269 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.102056 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.102107 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.102181 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.102500 (+ 319us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.102545 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":98,"threads_started":1}
I20260806 00:53:37.102762 14443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.098323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:44609 (local address 127.0.0.1:34854)
0806 00:53:37.098446 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:37.098512 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:37.098574 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:37.099142 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:37.099143 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:37.099145 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:37.099178 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.099179 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.100543 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.100544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.101619 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.101621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.102425 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.102426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.102504 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.102508 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:37.102597 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 00:53:37.102671 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":79,"threads_started":1}
I20260806 00:53:37.102999 14448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.098735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34854 (local address 127.3.98.129:44609)
0806 00:53:37.098902 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.098907 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.098920 (+ 13us) server_negotiation.cc:407] Connection header received
0806 00:53:37.098962 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.098964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.098980 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.099138 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:37.099252 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.100389 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.101717 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.102317 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.102406 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.102485 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.102623 (+ 138us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.102672 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":96,"threads_started":1}
I20260806 00:53:37.103014 14446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.098559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:38141 (local address 127.0.0.1:45322)
0806 00:53:37.098939 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:37.098950 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:37.098991 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:37.099515 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:37.099516 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:37.099517 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:37.099555 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.099556 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.100755 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.100756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.101696 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.101700 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.102722 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.102723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.102837 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.102842 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:53:37.102891 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 00:53:37.102936 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":79,"threads_started":1}
I20260806 00:53:37.103116 14444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.098342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:37263 (local address 127.0.0.1:54242)
0806 00:53:37.098509 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:37.098521 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:37.098614 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:37.098864 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:37.098868 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:37.098870 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:37.098938 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.098939 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.100020 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.100021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.101165 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.101168 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.102247 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.102248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.102363 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.102378 (+ 15us) client_negotiation.cc:769] Sending connection context
0806 00:53:37.102997 (+ 619us) client_negotiation.cc:240] Negotiation successful
0806 00:53:37.103043 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":85,"threads_started":1}
I20260806 00:53:37.103502 14451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.099021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45322 (local address 127.3.98.130:38141)
0806 00:53:37.099359 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.099364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.099374 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:37.099411 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.099414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.099429 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.099505 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:37.099614 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.100673 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.101784 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.102534 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.102597 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.102681 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.103177 (+ 496us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.103395 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":86,"threads_started":1}
I20260806 00:53:37.103819 13950 tablet_service.cc:1467] Processing CreateTablet for tablet 2f4eef3679a840e88220f0e34521d444 (DEFAULT_TABLE table=test-table [id=98e096fdfad3407481d1d124d89d18b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:37.103830 14321 tablet_service.cc:1467] Processing CreateTablet for tablet 2f4eef3679a840e88220f0e34521d444 (DEFAULT_TABLE table=test-table [id=98e096fdfad3407481d1d124d89d18b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:37.104056 14136 tablet_service.cc:1467] Processing CreateTablet for tablet 2f4eef3679a840e88220f0e34521d444 (DEFAULT_TABLE table=test-table [id=98e096fdfad3407481d1d124d89d18b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:37.104249 13950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f4eef3679a840e88220f0e34521d444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:37.104254 14321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f4eef3679a840e88220f0e34521d444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:37.104439 14136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f4eef3679a840e88220f0e34521d444. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:37.106976 14452 tablet_bootstrap.cc:492] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0: Bootstrap starting.
I20260806 00:53:37.107872 14452 tablet_bootstrap.cc:654] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:37.108211 14452 log.cc:824] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:37.108500 14453 tablet_bootstrap.cc:492] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54: Bootstrap starting.
I20260806 00:53:37.108880 14454 tablet_bootstrap.cc:492] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da: Bootstrap starting.
I20260806 00:53:37.109107 14452 tablet_bootstrap.cc:492] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0: No bootstrap required, opened a new log
I20260806 00:53:37.109203 14452 ts_tablet_manager.cc:1397] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:53:37.109229 14453 tablet_bootstrap.cc:654] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:37.109513 14453 log.cc:824] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:37.109536 14454 tablet_bootstrap.cc:654] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:37.109861 14454 log.cc:824] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:37.110545 14453 tablet_bootstrap.cc:492] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54: No bootstrap required, opened a new log
I20260806 00:53:37.110617 14453 ts_tablet_manager.cc:1397] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:53:37.110682 14454 tablet_bootstrap.cc:492] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da: No bootstrap required, opened a new log
I20260806 00:53:37.110754 14454 ts_tablet_manager.cc:1397] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:53:37.111433 14452 raft_consensus.cc:348] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.111622 14452 raft_consensus.cc:374] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:37.111661 14452 raft_consensus.cc:729] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2dd4a94f1c24ff19ed13e78db71d2b0, State: Initialized, Role: FOLLOWER
I20260806 00:53:37.111783 14452 consensus_queue.cc:260] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.112087 14452 ts_tablet_manager.cc:1428] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:53:37.112115 14414 heartbeater.cc:503] Master 127.3.98.190:40109 was elected leader, sending a full tablet report...
I20260806 00:53:37.112417 14454 raft_consensus.cc:348] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.112634 14454 raft_consensus.cc:374] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:37.112684 14454 raft_consensus.cc:729] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7410f030c414b53a57f3bb402b093da, State: Initialized, Role: FOLLOWER
I20260806 00:53:37.112634 14453 raft_consensus.cc:348] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.112797 14453 raft_consensus.cc:374] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:37.112841 14453 raft_consensus.cc:729] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c56298a9b5904309bcccc8eba2c2fd54, State: Initialized, Role: FOLLOWER
I20260806 00:53:37.112843 14454 consensus_queue.cc:260] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.112960 14453 consensus_queue.cc:260] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.113252 14036 heartbeater.cc:503] Master 127.3.98.190:40109 was elected leader, sending a full tablet report...
I20260806 00:53:37.113143 14454 ts_tablet_manager.cc:1428] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 00:53:37.113240 14453 ts_tablet_manager.cc:1428] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:53:37.113590 14217 heartbeater.cc:503] Master 127.3.98.190:40109 was elected leader, sending a full tablet report...
W20260806 00:53:37.138664 14218 tablet.cc:2369] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 00:53:37.227205 14037 tablet.cc:2369] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 00:53:37.302599 14415 tablet.cc:2369] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:53:37.415726 14460 raft_consensus.cc:482] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:37.415854 14460 raft_consensus.cc:504] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.416244 14460 leader_election.cc:288] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c56298a9b5904309bcccc8eba2c2fd54 (127.3.98.129:44609), c2dd4a94f1c24ff19ed13e78db71d2b0 (127.3.98.131:37263)
I20260806 00:53:37.419445 14448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.416524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:35403 (local address 127.3.98.129:44609)
0806 00:53:37.416619 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.416622 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.416790 (+ 168us) server_negotiation.cc:407] Connection header received
0806 00:53:37.416829 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.416830 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.416844 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.416898 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:37.417096 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.417646 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.418676 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.419063 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.419147 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.419157 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.419306 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.419361 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 00:53:37.419468 14445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.416655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:50625 (local address 127.3.98.131:37263)
0806 00:53:37.416717 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.416719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.416821 (+ 102us) server_negotiation.cc:407] Connection header received
0806 00:53:37.416971 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.416972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.416985 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.417049 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:37.417231 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.417718 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.418722 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.419062 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.419162 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.419171 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.419358 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.419401 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 00:53:37.419485 14463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.416449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:44609 (local address 127.3.98.130:35403)
0806 00:53:37.416612 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:37.416628 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:37.416706 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:37.416917 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:37.416918 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:37.416920 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:37.417015 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.417017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.417735 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.417736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.418585 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.418587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.419153 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.419155 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.419232 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.419236 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:37.419280 (+ 44us) client_negotiation.cc:240] Negotiation successful
0806 00:53:37.419340 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":37,"thread_start_us":110,"threads_started":1}
I20260806 00:53:37.419492 14466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.416455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:37263 (local address 127.3.98.130:50625)
0806 00:53:37.416637 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:37.416648 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:37.416826 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:37.417089 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:37.417090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:37.417092 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:37.417161 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.417162 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.417810 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.417811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.418598 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.418600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.419183 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.419184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.419256 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.419260 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:37.419337 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 00:53:37.419378 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":2,"thread_start_us":81,"threads_started":1}
I20260806 00:53:37.420089 13978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f4eef3679a840e88220f0e34521d444" candidate_uuid: "b7410f030c414b53a57f3bb402b093da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56298a9b5904309bcccc8eba2c2fd54" is_pre_election: true
I20260806 00:53:37.420130 14351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f4eef3679a840e88220f0e34521d444" candidate_uuid: "b7410f030c414b53a57f3bb402b093da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" is_pre_election: true
I20260806 00:53:37.420287 13978 raft_consensus.cc:2454] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7410f030c414b53a57f3bb402b093da in term 0.
I20260806 00:53:37.420300 14351 raft_consensus.cc:2454] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7410f030c414b53a57f3bb402b093da in term 0.
I20260806 00:53:37.420598 14070 leader_election.cc:302] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7410f030c414b53a57f3bb402b093da, c56298a9b5904309bcccc8eba2c2fd54; no voters:
I20260806 00:53:37.420734 14460 raft_consensus.cc:2781] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:37.420791 14460 raft_consensus.cc:482] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:37.420816 14460 raft_consensus.cc:3037] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:37.421638 14460 raft_consensus.cc:504] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.421799 14460 leader_election.cc:288] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [CANDIDATE]: Term 1 election: Requested vote from peers c56298a9b5904309bcccc8eba2c2fd54 (127.3.98.129:44609), c2dd4a94f1c24ff19ed13e78db71d2b0 (127.3.98.131:37263)
I20260806 00:53:37.421979 14351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f4eef3679a840e88220f0e34521d444" candidate_uuid: "b7410f030c414b53a57f3bb402b093da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0"
I20260806 00:53:37.422080 14351 raft_consensus.cc:3037] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:37.422812 14351 raft_consensus.cc:2454] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7410f030c414b53a57f3bb402b093da in term 1.
I20260806 00:53:37.422962 13978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f4eef3679a840e88220f0e34521d444" candidate_uuid: "b7410f030c414b53a57f3bb402b093da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56298a9b5904309bcccc8eba2c2fd54"
I20260806 00:53:37.423055 14073 leader_election.cc:302] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7410f030c414b53a57f3bb402b093da, c2dd4a94f1c24ff19ed13e78db71d2b0; no voters:
I20260806 00:53:37.423084 13978 raft_consensus.cc:3037] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:37.423182 14460 raft_consensus.cc:2781] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:37.423431 14460 raft_consensus.cc:686] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [term 1 LEADER]: Becoming Leader. State: Replica: b7410f030c414b53a57f3bb402b093da, State: Running, Role: LEADER
I20260806 00:53:37.423545 14460 consensus_queue.cc:237] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.423998 13978 raft_consensus.cc:2454] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7410f030c414b53a57f3bb402b093da in term 1.
I20260806 00:53:37.424562 13774 catalog_manager.cc:5495] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da reported cstate change: term changed from 0 to 1, leader changed from <none> to b7410f030c414b53a57f3bb402b093da (127.3.98.130). New cstate: current_term: 1 leader_uuid: "b7410f030c414b53a57f3bb402b093da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } health_report { overall_health: HEALTHY } } }
I20260806 00:53:37.459635 14451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.457058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45338 (local address 127.3.98.130:38141)
0806 00:53:37.457133 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.457135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.457141 (+ 6us) server_negotiation.cc:407] Connection header received
0806 00:53:37.457178 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.457179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.457200 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.457287 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:37.457476 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.457965 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.458803 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.459021 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.459105 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.459282 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:37.459401 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:37.459502 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.459521 (+ 19us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.459543 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 00:53:37.461896 14351 raft_consensus.cc:1261] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Refusing update from remote peer b7410f030c414b53a57f3bb402b093da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:37.461910 13978 raft_consensus.cc:1261] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Refusing update from remote peer b7410f030c414b53a57f3bb402b093da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:37.462383 14467 consensus_queue.cc:1035] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:37.462551 14460 consensus_queue.cc:1035] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [LEADER]: Connected to new peer: Peer: permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:37.465662 14474 mvcc.cc:205] Tried to move back new op lower bound from 7315364321120555008 to 7315364320967581696. Current Snapshot: MvccSnapshot[applied={T|T < 7315364321120555008 or (T in {7315364321120555008})}]
I20260806 00:53:37.467814 13775 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:37.467922 13775 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:37.469177 13775 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda: Sending DeleteTablet for 3 replicas of tablet 2f4eef3679a840e88220f0e34521d444
I20260806 00:53:37.469578 13950 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f4eef3679a840e88220f0e34521d444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:37 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:34854
I20260806 00:53:37.469651 14321 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f4eef3679a840e88220f0e34521d444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:37 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:54242
I20260806 00:53:37.469805 14136 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f4eef3679a840e88220f0e34521d444 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:37 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:45322
I20260806 00:53:37.469878 13775 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53302:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:37.470031 13775 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:37.470041 14486 tablet_replica.cc:330] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54: stopping tablet replica
I20260806 00:53:37.470146 14486 raft_consensus.cc:2229] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:37.470269 14486 raft_consensus.cc:2258] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:37.470355 14488 tablet_replica.cc:330] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0: stopping tablet replica
I20260806 00:53:37.470454 14488 raft_consensus.cc:2229] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:37.470914 14486 ts_tablet_manager.cc:1905] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:37.471508 13950 tablet_service.cc:1467] Processing CreateTablet for tablet a769f088edd14fb2b029fb2af5db8d60 (DEFAULT_TABLE table=test-table [id=8536ed7d088f41fc83e7517b52e4ef4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:37.471668 13950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a769f088edd14fb2b029fb2af5db8d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:37.471820 14321 tablet_service.cc:1467] Processing CreateTablet for tablet a769f088edd14fb2b029fb2af5db8d60 (DEFAULT_TABLE table=test-table [id=8536ed7d088f41fc83e7517b52e4ef4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:37.471928 14321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a769f088edd14fb2b029fb2af5db8d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:37.473057 14486 ts_tablet_manager.cc:1918] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:37.473132 14486 log.cc:1196] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/wal/wals/2f4eef3679a840e88220f0e34521d444
I20260806 00:53:37.473333 14453 tablet_bootstrap.cc:492] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54: Bootstrap starting.
I20260806 00:53:37.473429 14486 ts_tablet_manager.cc:1939] T 2f4eef3679a840e88220f0e34521d444 P c56298a9b5904309bcccc8eba2c2fd54: Deleting consensus metadata
I20260806 00:53:37.473666 14452 tablet_bootstrap.cc:492] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0: Bootstrap starting.
I20260806 00:53:37.473781 14453 tablet_bootstrap.cc:654] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:37.474107 14452 tablet_bootstrap.cc:654] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:37.474392 13756 catalog_manager.cc:4841] TS c56298a9b5904309bcccc8eba2c2fd54 (127.3.98.129:44609): tablet 2f4eef3679a840e88220f0e34521d444 (table test-table [id=98e096fdfad3407481d1d124d89d18b2]) successfully deleted
I20260806 00:53:37.474509 14453 tablet_bootstrap.cc:492] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54: No bootstrap required, opened a new log
I20260806 00:53:37.474555 14453 ts_tablet_manager.cc:1397] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:37.474702 14136 tablet_service.cc:1467] Processing CreateTablet for tablet a769f088edd14fb2b029fb2af5db8d60 (DEFAULT_TABLE table=test-table [id=8536ed7d088f41fc83e7517b52e4ef4f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:37.474814 14136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a769f088edd14fb2b029fb2af5db8d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:37.474871 14452 tablet_bootstrap.cc:492] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0: No bootstrap required, opened a new log
I20260806 00:53:37.474856 14453 raft_consensus.cc:348] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.474912 14452 ts_tablet_manager.cc:1397] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:37.474941 14453 raft_consensus.cc:374] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:37.474965 14453 raft_consensus.cc:729] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c56298a9b5904309bcccc8eba2c2fd54, State: Initialized, Role: FOLLOWER
I20260806 00:53:37.475023 14453 consensus_queue.cc:260] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.475113 14453 ts_tablet_manager.cc:1428] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:37.475924 14454 tablet_bootstrap.cc:492] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da: Bootstrap starting.
I20260806 00:53:37.476081 14452 raft_consensus.cc:348] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.476191 14452 raft_consensus.cc:374] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:37.476239 14452 raft_consensus.cc:729] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2dd4a94f1c24ff19ed13e78db71d2b0, State: Initialized, Role: FOLLOWER
I20260806 00:53:37.476285 14452 consensus_queue.cc:260] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.476378 14454 tablet_bootstrap.cc:654] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:37.476413 14452 ts_tablet_manager.cc:1428] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:37.477142 14454 tablet_bootstrap.cc:492] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da: No bootstrap required, opened a new log
I20260806 00:53:37.477159 14488 raft_consensus.cc:2258] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:37.477200 14454 ts_tablet_manager.cc:1397] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:37.477339 14454 raft_consensus.cc:348] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.477430 14454 raft_consensus.cc:374] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:37.477470 14454 raft_consensus.cc:729] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7410f030c414b53a57f3bb402b093da, State: Initialized, Role: FOLLOWER
I20260806 00:53:37.477516 14454 consensus_queue.cc:260] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.477609 14454 ts_tablet_manager.cc:1428] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:37.477602 14488 ts_tablet_manager.cc:1905] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:37.479176 14488 ts_tablet_manager.cc:1918] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:37.479264 14488 log.cc:1196] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/2f4eef3679a840e88220f0e34521d444
I20260806 00:53:37.479591 14488 ts_tablet_manager.cc:1939] T 2f4eef3679a840e88220f0e34521d444 P c2dd4a94f1c24ff19ed13e78db71d2b0: Deleting consensus metadata
I20260806 00:53:37.480077 13759 catalog_manager.cc:4841] TS c2dd4a94f1c24ff19ed13e78db71d2b0 (127.3.98.131:37263): tablet 2f4eef3679a840e88220f0e34521d444 (table test-table [id=98e096fdfad3407481d1d124d89d18b2]) successfully deleted
I20260806 00:53:37.480607 14489 tablet_replica.cc:330] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da: stopping tablet replica
I20260806 00:53:37.480733 14489 raft_consensus.cc:2229] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:53:37.480882 14489 raft_consensus.cc:2258] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:37.481271 14489 ts_tablet_manager.cc:1905] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:37.482690 14489 ts_tablet_manager.cc:1918] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:37.482785 14489 log.cc:1196] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/2f4eef3679a840e88220f0e34521d444
I20260806 00:53:37.483105 14489 ts_tablet_manager.cc:1939] T 2f4eef3679a840e88220f0e34521d444 P b7410f030c414b53a57f3bb402b093da: Deleting consensus metadata
I20260806 00:53:37.483517 13756 catalog_manager.cc:4841] TS b7410f030c414b53a57f3bb402b093da (127.3.98.130:38141): tablet 2f4eef3679a840e88220f0e34521d444 (table test-table [id=98e096fdfad3407481d1d124d89d18b2]) successfully deleted
I20260806 00:53:37.680539 14462 raft_consensus.cc:482] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:37.680677 14462 raft_consensus.cc:504] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.681136 14462 leader_election.cc:288] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7410f030c414b53a57f3bb402b093da (127.3.98.130:38141), c2dd4a94f1c24ff19ed13e78db71d2b0 (127.3.98.131:37263)
I20260806 00:53:37.684532 14445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.681420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:45825 (local address 127.3.98.131:37263)
0806 00:53:37.681487 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.681490 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.681775 (+ 285us) server_negotiation.cc:407] Connection header received
0806 00:53:37.681809 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.681810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.681820 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.681898 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:37.682140 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.682622 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.683775 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.684126 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.684223 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.684231 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.684387 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.684427 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 00:53:37.684535 14451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.681565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:37189 (local address 127.3.98.130:38141)
0806 00:53:37.681624 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.681626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.681638 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:53:37.681767 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.681769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.681780 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.681814 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:37.682058 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.682565 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.683737 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.684119 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.684177 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.684213 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.684385 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.684430 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 00:53:37.684583 14493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.681348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:37263 (local address 127.3.98.129:45825)
0806 00:53:37.681647 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:37.681658 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:37.681744 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:37.681920 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:37.681921 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:37.681923 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:37.682051 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.682053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.682712 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.682713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.683658 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.683661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.684239 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.684241 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.684305 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.684309 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:37.684379 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 00:53:37.684427 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":29,"thread_start_us":70,"threads_started":1}
I20260806 00:53:37.684765 14495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.681348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:38141 (local address 127.3.98.129:37189)
0806 00:53:37.681546 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:37.681557 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:37.681645 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:37.681892 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:37.681893 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:37.681896 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:37.681982 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.681984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.682652 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.682653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.683649 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.683651 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.684223 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.684225 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.684306 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.684310 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:37.684379 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 00:53:37.684428 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":29,"thread_start_us":82,"threads_started":1}
I20260806 00:53:37.684892 14351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a769f088edd14fb2b029fb2af5db8d60" candidate_uuid: "c56298a9b5904309bcccc8eba2c2fd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" is_pre_election: true
I20260806 00:53:37.685024 14351 raft_consensus.cc:2454] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c56298a9b5904309bcccc8eba2c2fd54 in term 0.
I20260806 00:53:37.685236 13890 leader_election.cc:302] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2dd4a94f1c24ff19ed13e78db71d2b0, c56298a9b5904309bcccc8eba2c2fd54; no voters:
I20260806 00:53:37.685375 14462 raft_consensus.cc:2781] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:37.685417 14462 raft_consensus.cc:482] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:37.685441 14462 raft_consensus.cc:3037] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:37.685344 14159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a769f088edd14fb2b029fb2af5db8d60" candidate_uuid: "c56298a9b5904309bcccc8eba2c2fd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7410f030c414b53a57f3bb402b093da" is_pre_election: true
I20260806 00:53:37.685514 14159 raft_consensus.cc:2454] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c56298a9b5904309bcccc8eba2c2fd54 in term 0.
I20260806 00:53:37.686350 14462 raft_consensus.cc:504] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.686501 14462 leader_election.cc:288] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [CANDIDATE]: Term 1 election: Requested vote from peers b7410f030c414b53a57f3bb402b093da (127.3.98.130:38141), c2dd4a94f1c24ff19ed13e78db71d2b0 (127.3.98.131:37263)
I20260806 00:53:37.686648 14351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a769f088edd14fb2b029fb2af5db8d60" candidate_uuid: "c56298a9b5904309bcccc8eba2c2fd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0"
I20260806 00:53:37.686641 14159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a769f088edd14fb2b029fb2af5db8d60" candidate_uuid: "c56298a9b5904309bcccc8eba2c2fd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7410f030c414b53a57f3bb402b093da"
I20260806 00:53:37.686720 14351 raft_consensus.cc:3037] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:37.686739 14159 raft_consensus.cc:3037] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:37.687312 14351 raft_consensus.cc:2454] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c56298a9b5904309bcccc8eba2c2fd54 in term 1.
I20260806 00:53:37.687471 14159 raft_consensus.cc:2454] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c56298a9b5904309bcccc8eba2c2fd54 in term 1.
I20260806 00:53:37.687482 13890 leader_election.cc:302] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2dd4a94f1c24ff19ed13e78db71d2b0, c56298a9b5904309bcccc8eba2c2fd54; no voters:
I20260806 00:53:37.687587 14462 raft_consensus.cc:2781] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:37.687731 14462 raft_consensus.cc:686] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [term 1 LEADER]: Becoming Leader. State: Replica: c56298a9b5904309bcccc8eba2c2fd54, State: Running, Role: LEADER
I20260806 00:53:37.687812 14462 consensus_queue.cc:237] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.688652 13774 catalog_manager.cc:5495] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 reported cstate change: term changed from 0 to 1, leader changed from <none> to c56298a9b5904309bcccc8eba2c2fd54 (127.3.98.129). New cstate: current_term: 1 leader_uuid: "c56298a9b5904309bcccc8eba2c2fd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } health_report { overall_health: UNKNOWN } } }
Aug 06 00:53:37 dist-test-slave-44d2 krb5kdc[13719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977616, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.190@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
I20260806 00:53:37.733531 14507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.725352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53306 (local address 127.3.98.190:40109)
0806 00:53:37.725505 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.725507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.725597 (+ 90us) server_negotiation.cc:407] Connection header received
0806 00:53:37.725695 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.725696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.725711 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.725797 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:37.726305 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.727149 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.727860 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.728183 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.728256 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.730659 (+ 2403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:37.730660 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:37.730661 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:37.730668 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:37.732171 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:37.732626 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:37.732627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:37.732627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:37.732701 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:37.732914 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:37.732915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:37.732915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:37.733028 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:37.733107 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.733273 (+ 166us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.733413 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":127,"thread_start_us":73,"threads_started":1}
I20260806 00:53:37.733589 14505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.725276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:40109 (local address 127.0.0.1:53306)
0806 00:53:37.725509 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:37.725521 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:37.725619 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:37.725810 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:37.725811 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:37.726146 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:37.726214 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.726216 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.727241 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.727242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.727786 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.727788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.728262 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.728263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.728303 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.728908 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:37.728922 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:37.730588 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:37.732248 (+ 1660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:37.732255 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:37.732257 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:37.732451 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:37.732776 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:37.732777 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:37.732777 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:37.732844 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:37.733107 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:37.733117 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:37.733163 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 00:53:37.733248 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 00:53:37.733465 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":110,"thread_start_us":123,"threads_started":1}
I20260806 00:53:37.735476 13774 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:53306:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 00:53:37.735698 13774 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:37.737454 13950 tablet_service.cc:1467] Processing CreateTablet for tablet 6d02d6ce8f704b779a86329f0bb1304a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fcba703381064cabb29d54d253c35350]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 00:53:37.737479 14321 tablet_service.cc:1467] Processing CreateTablet for tablet 6d02d6ce8f704b779a86329f0bb1304a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fcba703381064cabb29d54d253c35350]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 00:53:37.737629 13950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d02d6ce8f704b779a86329f0bb1304a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:37.737628 14321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d02d6ce8f704b779a86329f0bb1304a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:37.739318 14453 tablet_bootstrap.cc:492] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54: Bootstrap starting.
I20260806 00:53:37.739318 14452 tablet_bootstrap.cc:492] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0: Bootstrap starting.
I20260806 00:53:37.739441 14136 tablet_service.cc:1467] Processing CreateTablet for tablet 6d02d6ce8f704b779a86329f0bb1304a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fcba703381064cabb29d54d253c35350]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 00:53:37.739634 14136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d02d6ce8f704b779a86329f0bb1304a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:37.739702 14453 tablet_bootstrap.cc:654] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:37.739730 14452 tablet_bootstrap.cc:654] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:37.740411 14452 tablet_bootstrap.cc:492] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0: No bootstrap required, opened a new log
I20260806 00:53:37.740532 14452 ts_tablet_manager.cc:1397] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:37.740717 14452 raft_consensus.cc:348] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.740810 14452 raft_consensus.cc:374] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:37.740845 14452 raft_consensus.cc:729] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2dd4a94f1c24ff19ed13e78db71d2b0, State: Initialized, Role: FOLLOWER
I20260806 00:53:37.740891 14452 consensus_queue.cc:260] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.741005 14452 ts_tablet_manager.cc:1428] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:37.741158 14458 tablet_replica.cc:439] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } }
I20260806 00:53:37.741272 14458 tablet_replica.cc:442] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:37.741321 14454 tablet_bootstrap.cc:492] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da: Bootstrap starting.
I20260806 00:53:37.741683 14454 tablet_bootstrap.cc:654] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:37.741701 14453 tablet_bootstrap.cc:492] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54: No bootstrap required, opened a new log
I20260806 00:53:37.741753 14453 ts_tablet_manager.cc:1397] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:53:37.741927 14453 raft_consensus.cc:348] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.742019 14453 raft_consensus.cc:374] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:37.742043 14453 raft_consensus.cc:729] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c56298a9b5904309bcccc8eba2c2fd54, State: Initialized, Role: FOLLOWER
I20260806 00:53:37.742093 14453 consensus_queue.cc:260] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.742211 14453 ts_tablet_manager.cc:1428] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:37.742262 14462 tablet_replica.cc:439] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } }
I20260806 00:53:37.742375 14462 tablet_replica.cc:442] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:37.742808 14454 tablet_bootstrap.cc:492] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da: No bootstrap required, opened a new log
I20260806 00:53:37.742871 14454 ts_tablet_manager.cc:1397] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 00:53:37.742986 14454 raft_consensus.cc:348] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.743041 14454 raft_consensus.cc:374] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:37.743055 14454 raft_consensus.cc:729] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7410f030c414b53a57f3bb402b093da, State: Initialized, Role: FOLLOWER
I20260806 00:53:37.743115 14454 consensus_queue.cc:260] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.743244 14454 ts_tablet_manager.cc:1428] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:37.743269 14460 tablet_replica.cc:439] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } }
I20260806 00:53:37.743379 14460 tablet_replica.cc:442] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:37.861675 14462 raft_consensus.cc:482] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:37.861784 14462 raft_consensus.cc:504] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.861967 14462 leader_election.cc:288] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2dd4a94f1c24ff19ed13e78db71d2b0 (127.3.98.131:37263), b7410f030c414b53a57f3bb402b093da (127.3.98.130:38141)
I20260806 00:53:37.862280 14351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d02d6ce8f704b779a86329f0bb1304a" candidate_uuid: "c56298a9b5904309bcccc8eba2c2fd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" is_pre_election: true
I20260806 00:53:37.862280 14159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d02d6ce8f704b779a86329f0bb1304a" candidate_uuid: "c56298a9b5904309bcccc8eba2c2fd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7410f030c414b53a57f3bb402b093da" is_pre_election: true
I20260806 00:53:37.862394 14351 raft_consensus.cc:2454] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c56298a9b5904309bcccc8eba2c2fd54 in term 0.
I20260806 00:53:37.862394 14159 raft_consensus.cc:2454] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c56298a9b5904309bcccc8eba2c2fd54 in term 0.
I20260806 00:53:37.862576 13886 leader_election.cc:302] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7410f030c414b53a57f3bb402b093da, c56298a9b5904309bcccc8eba2c2fd54; no voters:
I20260806 00:53:37.862725 14462 raft_consensus.cc:2781] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:37.862802 14462 raft_consensus.cc:482] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:37.862833 14462 raft_consensus.cc:3037] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:37.863611 14462 raft_consensus.cc:504] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.863775 14462 leader_election.cc:288] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [CANDIDATE]: Term 1 election: Requested vote from peers c2dd4a94f1c24ff19ed13e78db71d2b0 (127.3.98.131:37263), b7410f030c414b53a57f3bb402b093da (127.3.98.130:38141)
I20260806 00:53:37.863929 14351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d02d6ce8f704b779a86329f0bb1304a" candidate_uuid: "c56298a9b5904309bcccc8eba2c2fd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0"
I20260806 00:53:37.863991 14159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d02d6ce8f704b779a86329f0bb1304a" candidate_uuid: "c56298a9b5904309bcccc8eba2c2fd54" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7410f030c414b53a57f3bb402b093da"
I20260806 00:53:37.864037 14351 raft_consensus.cc:3037] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:37.864070 14159 raft_consensus.cc:3037] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:37.864915 14351 raft_consensus.cc:2454] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c56298a9b5904309bcccc8eba2c2fd54 in term 1.
I20260806 00:53:37.864931 14159 raft_consensus.cc:2454] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c56298a9b5904309bcccc8eba2c2fd54 in term 1.
I20260806 00:53:37.865150 13890 leader_election.cc:302] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2dd4a94f1c24ff19ed13e78db71d2b0, c56298a9b5904309bcccc8eba2c2fd54; no voters:
I20260806 00:53:37.865303 14462 raft_consensus.cc:2781] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:37.865401 14462 raft_consensus.cc:686] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [term 1 LEADER]: Becoming Leader. State: Replica: c56298a9b5904309bcccc8eba2c2fd54, State: Running, Role: LEADER
I20260806 00:53:37.865464 14462 consensus_queue.cc:237] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } }
I20260806 00:53:37.865908 14497 tablet_replica.cc:439] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54: TxnStatusTablet state changed. Reason: New leader c56298a9b5904309bcccc8eba2c2fd54. Latest consensus state: current_term: 1 leader_uuid: "c56298a9b5904309bcccc8eba2c2fd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } }
I20260806 00:53:37.866024 14497 tablet_replica.cc:442] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54: This TxnStatusTablet replica's current role is: LEADER
I20260806 00:53:37.866313 14512 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 00:53:37.866364 13774 catalog_manager.cc:5495] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 reported cstate change: term changed from 0 to 1, leader changed from <none> to c56298a9b5904309bcccc8eba2c2fd54 (127.3.98.129). New cstate: current_term: 1 leader_uuid: "c56298a9b5904309bcccc8eba2c2fd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260806 00:53:37.866461 14512 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 00:53:37.887490 14448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.884728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34856 (local address 127.3.98.129:44609)
0806 00:53:37.884780 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.884782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.884792 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:37.884886 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.884887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.884908 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.884985 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:37.885155 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.885764 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.886651 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.886863 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.886942 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.887143 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:37.887254 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:37.887334 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.887390 (+ 56us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.887413 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 00:53:37.887533 14505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.884650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:44609 (local address 127.0.0.1:34856)
0806 00:53:37.884731 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:37.884743 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:37.884798 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:37.885007 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:37.885009 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:37.885010 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 00:53:37.885074 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.885077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.885850 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.885852 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.886565 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.886577 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.886941 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.886942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.886999 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.887027 (+ 28us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 00:53:37.887329 (+ 302us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 00:53:37.887341 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 00:53:37.887387 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 00:53:37.887456 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 00:53:37.892319 14351 raft_consensus.cc:1261] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Refusing update from remote peer c56298a9b5904309bcccc8eba2c2fd54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:37.892386 14159 raft_consensus.cc:1261] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Refusing update from remote peer c56298a9b5904309bcccc8eba2c2fd54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:37.892643 14497 consensus_queue.cc:1035] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:37.892791 14462 consensus_queue.cc:1035] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:37.893430 14458 tablet_replica.cc:439] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0: TxnStatusTablet state changed. Reason: New leader c56298a9b5904309bcccc8eba2c2fd54. Latest consensus state: current_term: 1 leader_uuid: "c56298a9b5904309bcccc8eba2c2fd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } }
I20260806 00:53:37.893533 14458 tablet_replica.cc:442] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:37.893975 14460 tablet_replica.cc:439] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da: TxnStatusTablet state changed. Reason: New leader c56298a9b5904309bcccc8eba2c2fd54. Latest consensus state: current_term: 1 leader_uuid: "c56298a9b5904309bcccc8eba2c2fd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } }
I20260806 00:53:37.894080 14460 tablet_replica.cc:442] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:37.894340 14497 tablet_replica.cc:439] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c56298a9b5904309bcccc8eba2c2fd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } }
I20260806 00:53:37.894426 14497 tablet_replica.cc:442] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54: This TxnStatusTablet replica's current role is: LEADER
I20260806 00:53:37.894404 14462 tablet_replica.cc:439] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c56298a9b5904309bcccc8eba2c2fd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } }
I20260806 00:53:37.894503 14462 tablet_replica.cc:442] T 6d02d6ce8f704b779a86329f0bb1304a P c56298a9b5904309bcccc8eba2c2fd54: This TxnStatusTablet replica's current role is: LEADER
I20260806 00:53:37.894759 14473 mvcc.cc:205] Tried to move back new op lower bound from 7315364322884485120 to 7315364322777534464. Current Snapshot: MvccSnapshot[applied={T|T < 7315364322884485120}]
I20260806 00:53:37.894819 14472 mvcc.cc:205] Tried to move back new op lower bound from 7315364322884485120 to 7315364322777534464. Current Snapshot: MvccSnapshot[applied={T|T < 7315364322884485120 or (T in {7315364322884485120})}]
I20260806 00:53:37.894901 14458 tablet_replica.cc:439] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c56298a9b5904309bcccc8eba2c2fd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } }
I20260806 00:53:37.894987 14458 tablet_replica.cc:442] T 6d02d6ce8f704b779a86329f0bb1304a P c2dd4a94f1c24ff19ed13e78db71d2b0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:37.895392 14460 tablet_replica.cc:439] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c56298a9b5904309bcccc8eba2c2fd54" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } }
I20260806 00:53:37.895478 14460 tablet_replica.cc:442] T 6d02d6ce8f704b779a86329f0bb1304a P b7410f030c414b53a57f3bb402b093da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 00:53:37.898833 14448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.896373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34862 (local address 127.3.98.129:44609)
0806 00:53:37.896415 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.896417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.896424 (+ 7us) server_negotiation.cc:407] Connection header received
0806 00:53:37.896472 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.896473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.896501 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.896556 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:37.896714 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.897174 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.898273 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.898445 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.898498 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.898654 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:37.898681 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:37.898718 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.898769 (+ 51us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.898784 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:53:37.904593 14448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.901729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:41613 (local address 127.3.98.129:44609)
0806 00:53:37.901783 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.901785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.901918 (+ 133us) server_negotiation.cc:407] Connection header received
0806 00:53:37.902017 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.902018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.902025 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.902083 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:37.902204 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.902767 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.903791 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.904044 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.904115 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.904324 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:37.904357 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:37.904405 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.904458 (+ 53us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.904504 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":17}
I20260806 00:53:37.904666 14523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.901673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:44609 (local address 127.3.98.129:41613)
0806 00:53:37.901847 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:37.901860 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:37.901934 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:37.902087 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:37.902087 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:37.902089 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 00:53:37.902151 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.902153 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.902857 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.902858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.903688 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:37.903691 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.904134 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.904135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:37.904198 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.904217 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 00:53:37.904403 (+ 186us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 00:53:37.904404 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 00:53:37.904454 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 00:53:37.904523 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":22,"thread_start_us":95,"threads_started":1}
I20260806 00:53:37.907689 14351 raft_consensus.cc:1261] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Refusing update from remote peer c56298a9b5904309bcccc8eba2c2fd54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:37.907778 14159 raft_consensus.cc:1261] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Refusing update from remote peer c56298a9b5904309bcccc8eba2c2fd54: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:37.907896 14462 consensus_queue.cc:1035] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:37.908136 14462 consensus_queue.cc:1035] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:37.920697 13775 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:37.920815 13775 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:37.921484 13775 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda: Sending DeleteTablet for 3 replicas of tablet a769f088edd14fb2b029fb2af5db8d60
I20260806 00:53:37.921777 14136 tablet_service.cc:1514] Processing DeleteTablet for tablet a769f088edd14fb2b029fb2af5db8d60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:37 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:45322
I20260806 00:53:37.921780 14321 tablet_service.cc:1514] Processing DeleteTablet for tablet a769f088edd14fb2b029fb2af5db8d60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:37 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:54242
I20260806 00:53:37.921880 14489 tablet_replica.cc:330] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da: stopping tablet replica
I20260806 00:53:37.921881 14488 tablet_replica.cc:330] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0: stopping tablet replica
I20260806 00:53:37.921929 14489 raft_consensus.cc:2229] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:37.921949 14488 raft_consensus.cc:2229] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:37.921964 14489 raft_consensus.cc:2258] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:37.921976 14488 raft_consensus.cc:2258] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:37.922070 13947 tablet_service.cc:1514] Processing DeleteTablet for tablet a769f088edd14fb2b029fb2af5db8d60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:37 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:34854
I20260806 00:53:37.922181 14486 tablet_replica.cc:330] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54: stopping tablet replica
I20260806 00:53:37.922243 14486 raft_consensus.cc:2229] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:53:37.922325 14486 raft_consensus.cc:2258] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:37.922600 14486 ts_tablet_manager.cc:1905] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:37.922710 14488 ts_tablet_manager.cc:1905] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:37.923915 14489 ts_tablet_manager.cc:1905] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:37.924127 14488 ts_tablet_manager.cc:1918] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:37.924180 14488 log.cc:1196] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/a769f088edd14fb2b029fb2af5db8d60
I20260806 00:53:37.924322 14486 ts_tablet_manager.cc:1918] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:37.924382 14486 log.cc:1196] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/wal/wals/a769f088edd14fb2b029fb2af5db8d60
I20260806 00:53:37.924409 14488 ts_tablet_manager.cc:1939] T a769f088edd14fb2b029fb2af5db8d60 P c2dd4a94f1c24ff19ed13e78db71d2b0: Deleting consensus metadata
I20260806 00:53:37.924628 14486 ts_tablet_manager.cc:1939] T a769f088edd14fb2b029fb2af5db8d60 P c56298a9b5904309bcccc8eba2c2fd54: Deleting consensus metadata
I20260806 00:53:37.924769 13759 catalog_manager.cc:4841] TS c2dd4a94f1c24ff19ed13e78db71d2b0 (127.3.98.131:37263): tablet a769f088edd14fb2b029fb2af5db8d60 (table test-table [id=8536ed7d088f41fc83e7517b52e4ef4f]) successfully deleted
I20260806 00:53:37.925571 14489 ts_tablet_manager.cc:1918] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:37.925630 14489 log.cc:1196] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/a769f088edd14fb2b029fb2af5db8d60
I20260806 00:53:37.925812 14489 ts_tablet_manager.cc:1939] T a769f088edd14fb2b029fb2af5db8d60 P b7410f030c414b53a57f3bb402b093da: Deleting consensus metadata
I20260806 00:53:37.928017 13756 catalog_manager.cc:4841] TS c56298a9b5904309bcccc8eba2c2fd54 (127.3.98.129:44609): tablet a769f088edd14fb2b029fb2af5db8d60 (table test-table [id=8536ed7d088f41fc83e7517b52e4ef4f]) successfully deleted
I20260806 00:53:37.928097 13756 catalog_manager.cc:4841] TS b7410f030c414b53a57f3bb402b093da (127.3.98.130:38141): tablet a769f088edd14fb2b029fb2af5db8d60 (table test-table [id=8536ed7d088f41fc83e7517b52e4ef4f]) successfully deleted
Aug 06 00:53:37 dist-test-slave-44d2 krb5kdc[13719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 00:53:37 dist-test-slave-44d2 krb5kdc[13719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:37 dist-test-slave-44d2 krb5kdc[13719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 00:53:37.950799 14507 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:37.944290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53310 (local address 127.3.98.190:40109)
0806 00:53:37.944350 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.944358 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.944449 (+ 91us) server_negotiation.cc:407] Connection header received
0806 00:53:37.944626 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.944627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.944638 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.944692 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:37.945476 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.945998 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.947122 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.947323 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.947382 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.950727 (+ 3345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53310: BlockingRecv error: recv got EOF from 127.0.0.1:53310 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 06 00:53:37 dist-test-slave-44d2 krb5kdc[13719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM
I20260806 00:53:37.960239 14507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:37.951720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53316 (local address 127.3.98.190:40109)
0806 00:53:37.951780 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:37.951782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:37.951817 (+ 35us) server_negotiation.cc:407] Connection header received
0806 00:53:37.951839 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:37.951840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:37.951851 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:37.951903 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:37.952339 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.953104 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.953805 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:37.954083 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:37.954201 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:37.957009 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:37.957011 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:37.957011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:37.957020 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:37.959092 (+ 2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:37.959442 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:37.959443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:37.959444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:37.959507 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:37.959723 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:37.959723 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:37.959724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:37.959839 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:37.959945 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:37.960046 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 00:53:37.960128 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 00:53:37.961902 13775 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:37.962092 13775 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:37.963608 14136 tablet_service.cc:1467] Processing CreateTablet for tablet 2a7834c0eca346498811cc43beddf953 (DEFAULT_TABLE table=test-table [id=d55fb146253f436288c0d281b58cbb9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:37.963606 13947 tablet_service.cc:1467] Processing CreateTablet for tablet 2a7834c0eca346498811cc43beddf953 (DEFAULT_TABLE table=test-table [id=d55fb146253f436288c0d281b58cbb9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:37.963757 14136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a7834c0eca346498811cc43beddf953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:37.963757 13947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a7834c0eca346498811cc43beddf953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:37.965335 14454 tablet_bootstrap.cc:492] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da: Bootstrap starting.
I20260806 00:53:37.965446 14453 tablet_bootstrap.cc:492] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54: Bootstrap starting.
I20260806 00:53:37.965449 14321 tablet_service.cc:1467] Processing CreateTablet for tablet 2a7834c0eca346498811cc43beddf953 (DEFAULT_TABLE table=test-table [id=d55fb146253f436288c0d281b58cbb9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:37.965579 14321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a7834c0eca346498811cc43beddf953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:37.965718 14454 tablet_bootstrap.cc:654] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:37.965893 14453 tablet_bootstrap.cc:654] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:37.966648 14453 tablet_bootstrap.cc:492] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54: No bootstrap required, opened a new log
I20260806 00:53:37.966709 14453 ts_tablet_manager.cc:1397] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:37.966861 14452 tablet_bootstrap.cc:492] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0: Bootstrap starting.
I20260806 00:53:37.966859 14453 raft_consensus.cc:348] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.966949 14453 raft_consensus.cc:374] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:37.966974 14453 raft_consensus.cc:729] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c56298a9b5904309bcccc8eba2c2fd54, State: Initialized, Role: FOLLOWER
I20260806 00:53:37.967021 14453 consensus_queue.cc:260] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.967118 14453 ts_tablet_manager.cc:1428] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:37.967308 14452 tablet_bootstrap.cc:654] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:37.967504 14454 tablet_bootstrap.cc:492] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da: No bootstrap required, opened a new log
I20260806 00:53:37.967550 14454 ts_tablet_manager.cc:1397] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 00:53:37.967661 14454 raft_consensus.cc:348] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.967733 14454 raft_consensus.cc:374] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:37.967752 14454 raft_consensus.cc:729] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7410f030c414b53a57f3bb402b093da, State: Initialized, Role: FOLLOWER
I20260806 00:53:37.967788 14454 consensus_queue.cc:260] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.967869 14454 ts_tablet_manager.cc:1428] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:37.968201 14452 tablet_bootstrap.cc:492] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0: No bootstrap required, opened a new log
I20260806 00:53:37.968273 14452 ts_tablet_manager.cc:1397] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:37.968423 14452 raft_consensus.cc:348] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.968472 14452 raft_consensus.cc:374] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:37.968538 14452 raft_consensus.cc:729] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2dd4a94f1c24ff19ed13e78db71d2b0, State: Initialized, Role: FOLLOWER
I20260806 00:53:37.968590 14452 consensus_queue.cc:260] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:37.968708 14452 ts_tablet_manager.cc:1428] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:38.308169 14458 raft_consensus.cc:482] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:38.308310 14458 raft_consensus.cc:504] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:38.308777 14458 leader_election.cc:288] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c56298a9b5904309bcccc8eba2c2fd54 (127.3.98.129:44609), b7410f030c414b53a57f3bb402b093da (127.3.98.130:38141)
I20260806 00:53:38.312191 14448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:38.309069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:49563 (local address 127.3.98.129:44609)
0806 00:53:38.309152 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:38.309155 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:38.309286 (+ 131us) server_negotiation.cc:407] Connection header received
0806 00:53:38.309334 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:38.309335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:38.309348 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:38.309458 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:38.309674 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.310340 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.311359 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.311802 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.311877 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:38.311911 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:38.312065 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 00:53:38.312112 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 00:53:38.312166 14554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:38.308993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:44609 (local address 127.3.98.131:49563)
0806 00:53:38.309131 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:38.309144 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:38.309213 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:38.309493 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:38.309495 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:38.309497 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:38.309588 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:38.309591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.310468 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.310469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:38.311254 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:38.311256 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.311893 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.311895 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:38.311971 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:38.311977 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 00:53:38.312026 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 00:53:38.312056 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":23,"thread_start_us":91,"threads_started":1}
I20260806 00:53:38.312280 14556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:38.309311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:54793 (local address 127.3.98.130:38141)
0806 00:53:38.309508 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:38.309510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:38.309518 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:53:38.309544 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:38.309545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:38.309556 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:38.309627 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:53:38.309840 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.310330 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.311441 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.311821 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.311920 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:38.311931 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:38.312137 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 00:53:38.312196 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":99,"threads_started":1}
I20260806 00:53:38.312358 14555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:38.309206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:38141 (local address 127.3.98.131:54793)
0806 00:53:38.309315 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:38.309323 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:38.309363 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:38.309675 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:38.309677 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:38.309680 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:53:38.309754 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:38.309756 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.310434 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.310436 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:38.311333 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:38.311337 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.311946 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.311947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:38.312046 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:38.312052 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 00:53:38.312118 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 00:53:38.312160 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":67,"threads_started":1}
I20260806 00:53:38.312462 13978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a7834c0eca346498811cc43beddf953" candidate_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56298a9b5904309bcccc8eba2c2fd54" is_pre_election: true
I20260806 00:53:38.312589 13978 raft_consensus.cc:2454] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2dd4a94f1c24ff19ed13e78db71d2b0 in term 0.
I20260806 00:53:38.312676 14158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a7834c0eca346498811cc43beddf953" candidate_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7410f030c414b53a57f3bb402b093da" is_pre_election: true
I20260806 00:53:38.312794 14158 raft_consensus.cc:2454] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2dd4a94f1c24ff19ed13e78db71d2b0 in term 0.
I20260806 00:53:38.312799 14257 leader_election.cc:302] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2dd4a94f1c24ff19ed13e78db71d2b0, c56298a9b5904309bcccc8eba2c2fd54; no voters:
I20260806 00:53:38.312947 14458 raft_consensus.cc:2781] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:38.313011 14458 raft_consensus.cc:482] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:38.313047 14458 raft_consensus.cc:3037] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:38.313783 14458 raft_consensus.cc:504] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:38.313931 14458 leader_election.cc:288] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [CANDIDATE]: Term 1 election: Requested vote from peers c56298a9b5904309bcccc8eba2c2fd54 (127.3.98.129:44609), b7410f030c414b53a57f3bb402b093da (127.3.98.130:38141)
I20260806 00:53:38.314131 13978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a7834c0eca346498811cc43beddf953" candidate_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56298a9b5904309bcccc8eba2c2fd54"
I20260806 00:53:38.314234 13978 raft_consensus.cc:3037] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:38.314225 14158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a7834c0eca346498811cc43beddf953" candidate_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7410f030c414b53a57f3bb402b093da"
I20260806 00:53:38.314354 14158 raft_consensus.cc:3037] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:38.314960 13978 raft_consensus.cc:2454] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2dd4a94f1c24ff19ed13e78db71d2b0 in term 1.
I20260806 00:53:38.315037 14158 raft_consensus.cc:2454] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2dd4a94f1c24ff19ed13e78db71d2b0 in term 1.
I20260806 00:53:38.315133 14257 leader_election.cc:302] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c2dd4a94f1c24ff19ed13e78db71d2b0, c56298a9b5904309bcccc8eba2c2fd54; no voters:
I20260806 00:53:38.315240 14458 raft_consensus.cc:2781] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:38.315375 14458 raft_consensus.cc:686] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 LEADER]: Becoming Leader. State: Replica: c2dd4a94f1c24ff19ed13e78db71d2b0, State: Running, Role: LEADER
I20260806 00:53:38.315446 14458 consensus_queue.cc:237] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:38.316179 13775 catalog_manager.cc:5495] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2dd4a94f1c24ff19ed13e78db71d2b0 (127.3.98.131). New cstate: current_term: 1 leader_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } health_report { overall_health: HEALTHY } } }
I20260806 00:53:38.323566 14560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:38.321098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54246 (local address 127.3.98.131:37263)
0806 00:53:38.321258 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:38.321260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:38.321268 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:53:38.321310 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:38.321311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:38.321328 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:38.321401 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:38.321508 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.322050 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.322759 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.323001 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.323062 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:38.323203 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:38.323304 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:38.323360 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:38.323395 (+ 35us) server_negotiation.cc:299] Negotiation successful
0806 00:53:38.323413 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":113,"threads_started":1}
I20260806 00:53:38.324525 13978 raft_consensus.cc:1261] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Refusing update from remote peer c2dd4a94f1c24ff19ed13e78db71d2b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:38.324528 14158 raft_consensus.cc:1261] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Refusing update from remote peer c2dd4a94f1c24ff19ed13e78db71d2b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:38.324815 14458 consensus_queue.cc:1035] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:38.324972 14557 consensus_queue.cc:1035] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:38.328358 13774 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:38.328447 13774 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:38.329131 13774 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda: Sending DeleteTablet for 3 replicas of tablet 2a7834c0eca346498811cc43beddf953
I20260806 00:53:38.329412 13947 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a7834c0eca346498811cc43beddf953 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:38 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:34854
I20260806 00:53:38.329420 14321 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a7834c0eca346498811cc43beddf953 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:38 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:54242
I20260806 00:53:38.329502 14486 tablet_replica.cc:330] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54: stopping tablet replica
I20260806 00:53:38.329510 14488 tablet_replica.cc:330] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0: stopping tablet replica
I20260806 00:53:38.329517 14136 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a7834c0eca346498811cc43beddf953 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:38 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:45322
I20260806 00:53:38.329556 14486 raft_consensus.cc:2229] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:38.329571 14488 raft_consensus.cc:2229] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:53:38.329613 14489 tablet_replica.cc:330] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da: stopping tablet replica
I20260806 00:53:38.329617 14486 raft_consensus.cc:2258] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:38.329649 14488 raft_consensus.cc:2258] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:38.329663 14489 raft_consensus.cc:2229] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:38.329704 14489 raft_consensus.cc:2258] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:38.329924 14488 ts_tablet_manager.cc:1905] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:38.330097 14486 ts_tablet_manager.cc:1905] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:38.330284 13774 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:53:38.330418 13774 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:53:38.331579 14488 ts_tablet_manager.cc:1918] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:38.331647 14488 log.cc:1196] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/2a7834c0eca346498811cc43beddf953
I20260806 00:53:38.331701 14486 ts_tablet_manager.cc:1918] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:38.331750 14486 log.cc:1196] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-0/wal/wals/2a7834c0eca346498811cc43beddf953
I20260806 00:53:38.331902 14488 ts_tablet_manager.cc:1939] T 2a7834c0eca346498811cc43beddf953 P c2dd4a94f1c24ff19ed13e78db71d2b0: Deleting consensus metadata
I20260806 00:53:38.331962 14486 ts_tablet_manager.cc:1939] T 2a7834c0eca346498811cc43beddf953 P c56298a9b5904309bcccc8eba2c2fd54: Deleting consensus metadata
I20260806 00:53:38.332283 13756 catalog_manager.cc:4841] TS c56298a9b5904309bcccc8eba2c2fd54 (127.3.98.129:44609): tablet 2a7834c0eca346498811cc43beddf953 (table test-table [id=d55fb146253f436288c0d281b58cbb9c]) successfully deleted
I20260806 00:53:38.332504 13759 catalog_manager.cc:4841] TS c2dd4a94f1c24ff19ed13e78db71d2b0 (127.3.98.131:37263): tablet 2a7834c0eca346498811cc43beddf953 (table test-table [id=d55fb146253f436288c0d281b58cbb9c]) successfully deleted
I20260806 00:53:38.333261 14489 ts_tablet_manager.cc:1905] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:38.334416 14489 ts_tablet_manager.cc:1918] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:53:38.334481 14489 log.cc:1196] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/2a7834c0eca346498811cc43beddf953
I20260806 00:53:38.334661 13947 tablet_service.cc:1467] Processing CreateTablet for tablet 843e9d9529244ec98a0cc9a6e352125c (DEFAULT_TABLE table=test-table [id=b7dbb70ede4b4a35bbbec2fd85cf9bab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:38.334717 14489 ts_tablet_manager.cc:1939] T 2a7834c0eca346498811cc43beddf953 P b7410f030c414b53a57f3bb402b093da: Deleting consensus metadata
I20260806 00:53:38.334769 13947 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 843e9d9529244ec98a0cc9a6e352125c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:38.334997 14321 tablet_service.cc:1467] Processing CreateTablet for tablet 843e9d9529244ec98a0cc9a6e352125c (DEFAULT_TABLE table=test-table [id=b7dbb70ede4b4a35bbbec2fd85cf9bab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:38.335058 13756 catalog_manager.cc:4841] TS b7410f030c414b53a57f3bb402b093da (127.3.98.130:38141): tablet 2a7834c0eca346498811cc43beddf953 (table test-table [id=d55fb146253f436288c0d281b58cbb9c]) successfully deleted
I20260806 00:53:38.335093 14321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 843e9d9529244ec98a0cc9a6e352125c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:38.336115 14453 tablet_bootstrap.cc:492] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54: Bootstrap starting.
I20260806 00:53:38.336318 14452 tablet_bootstrap.cc:492] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0: Bootstrap starting.
I20260806 00:53:38.336347 14136 tablet_service.cc:1467] Processing CreateTablet for tablet 843e9d9529244ec98a0cc9a6e352125c (DEFAULT_TABLE table=test-table [id=b7dbb70ede4b4a35bbbec2fd85cf9bab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:53:38.336428 14453 tablet_bootstrap.cc:654] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:38.336447 14136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 843e9d9529244ec98a0cc9a6e352125c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:38.336740 14452 tablet_bootstrap.cc:654] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:38.337466 14452 tablet_bootstrap.cc:492] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0: No bootstrap required, opened a new log
I20260806 00:53:38.337510 14452 ts_tablet_manager.cc:1397] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:38.337642 14454 tablet_bootstrap.cc:492] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da: Bootstrap starting.
I20260806 00:53:38.337641 14452 raft_consensus.cc:348] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:38.337698 14452 raft_consensus.cc:374] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:38.337728 14452 raft_consensus.cc:729] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2dd4a94f1c24ff19ed13e78db71d2b0, State: Initialized, Role: FOLLOWER
I20260806 00:53:38.337769 14452 consensus_queue.cc:260] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:38.337857 14452 ts_tablet_manager.cc:1428] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:38.337944 14454 tablet_bootstrap.cc:654] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:38.338330 14453 tablet_bootstrap.cc:492] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54: No bootstrap required, opened a new log
I20260806 00:53:38.338385 14453 ts_tablet_manager.cc:1397] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:53:38.338490 14453 raft_consensus.cc:348] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:38.338587 14453 raft_consensus.cc:374] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:38.338613 14453 raft_consensus.cc:729] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c56298a9b5904309bcccc8eba2c2fd54, State: Initialized, Role: FOLLOWER
I20260806 00:53:38.338670 14453 consensus_queue.cc:260] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:38.338775 14453 ts_tablet_manager.cc:1428] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:38.339319 14454 tablet_bootstrap.cc:492] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da: No bootstrap required, opened a new log
I20260806 00:53:38.339378 14454 ts_tablet_manager.cc:1397] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260806 00:53:38.339474 14454 raft_consensus.cc:348] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:38.339546 14454 raft_consensus.cc:374] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:38.339567 14454 raft_consensus.cc:729] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7410f030c414b53a57f3bb402b093da, State: Initialized, Role: FOLLOWER
I20260806 00:53:38.339607 14454 consensus_queue.cc:260] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:38.339699 14454 ts_tablet_manager.cc:1428] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:38.598927 14565 raft_consensus.cc:482] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:53:38.599102 14565 raft_consensus.cc:504] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:38.599332 14565 leader_election.cc:288] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c56298a9b5904309bcccc8eba2c2fd54 (127.3.98.129:44609), b7410f030c414b53a57f3bb402b093da (127.3.98.130:38141)
I20260806 00:53:38.599637 13978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "843e9d9529244ec98a0cc9a6e352125c" candidate_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56298a9b5904309bcccc8eba2c2fd54" is_pre_election: true
I20260806 00:53:38.599681 14158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "843e9d9529244ec98a0cc9a6e352125c" candidate_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7410f030c414b53a57f3bb402b093da" is_pre_election: true
I20260806 00:53:38.599758 13978 raft_consensus.cc:2454] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2dd4a94f1c24ff19ed13e78db71d2b0 in term 0.
I20260806 00:53:38.599769 14158 raft_consensus.cc:2454] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c2dd4a94f1c24ff19ed13e78db71d2b0 in term 0.
I20260806 00:53:38.599951 14257 leader_election.cc:302] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7410f030c414b53a57f3bb402b093da, c2dd4a94f1c24ff19ed13e78db71d2b0; no voters:
I20260806 00:53:38.600069 14565 raft_consensus.cc:2781] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:53:38.600117 14565 raft_consensus.cc:482] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:53:38.600143 14565 raft_consensus.cc:3037] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:38.600983 14565 raft_consensus.cc:504] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:38.601115 14565 leader_election.cc:288] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [CANDIDATE]: Term 1 election: Requested vote from peers c56298a9b5904309bcccc8eba2c2fd54 (127.3.98.129:44609), b7410f030c414b53a57f3bb402b093da (127.3.98.130:38141)
I20260806 00:53:38.601327 13978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "843e9d9529244ec98a0cc9a6e352125c" candidate_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56298a9b5904309bcccc8eba2c2fd54"
I20260806 00:53:38.601416 13978 raft_consensus.cc:3037] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:38.601366 14158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "843e9d9529244ec98a0cc9a6e352125c" candidate_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7410f030c414b53a57f3bb402b093da"
I20260806 00:53:38.601470 14158 raft_consensus.cc:3037] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:38.602231 14158 raft_consensus.cc:2454] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2dd4a94f1c24ff19ed13e78db71d2b0 in term 1.
I20260806 00:53:38.602274 13978 raft_consensus.cc:2454] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2dd4a94f1c24ff19ed13e78db71d2b0 in term 1.
I20260806 00:53:38.602484 14257 leader_election.cc:302] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b7410f030c414b53a57f3bb402b093da, c2dd4a94f1c24ff19ed13e78db71d2b0; no voters:
I20260806 00:53:38.602615 14565 raft_consensus.cc:2781] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:38.602701 14565 raft_consensus.cc:686] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 LEADER]: Becoming Leader. State: Replica: c2dd4a94f1c24ff19ed13e78db71d2b0, State: Running, Role: LEADER
I20260806 00:53:38.602762 14565 consensus_queue.cc:237] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } }
I20260806 00:53:38.603442 13772 catalog_manager.cc:5495] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to c2dd4a94f1c24ff19ed13e78db71d2b0 (127.3.98.131). New cstate: current_term: 1 leader_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2dd4a94f1c24ff19ed13e78db71d2b0" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 37263 } health_report { overall_health: HEALTHY } } }
I20260806 00:53:38.626415 14448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:38.623759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:58599 (local address 127.3.98.129:44609)
0806 00:53:38.623851 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:38.623853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:38.623993 (+ 140us) server_negotiation.cc:407] Connection header received
0806 00:53:38.624077 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:38.624079 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:38.624090 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:38.624142 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:38.624269 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.624838 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.625644 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.625874 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.625959 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:38.626142 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:38.626182 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:38.626246 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:38.626313 (+ 67us) server_negotiation.cc:299] Negotiation successful
0806 00:53:38.626337 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 00:53:38.626458 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:38.623670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:44609 (local address 127.3.98.131:58599)
0806 00:53:38.623893 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:38.623928 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:38.624012 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:38.624143 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:38.624144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:38.624146 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 00:53:38.624205 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:38.624206 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.624926 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.624927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:38.625542 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:38.625544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.625958 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.625959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:38.626022 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:38.626044 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 00:53:38.626248 (+ 204us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 00:53:38.626251 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:38.626308 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 00:53:38.626370 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":113,"threads_started":1}
I20260806 00:53:38.628684 13978 raft_consensus.cc:1261] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Refusing update from remote peer c2dd4a94f1c24ff19ed13e78db71d2b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:38.628683 14158 raft_consensus.cc:1261] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Refusing update from remote peer c2dd4a94f1c24ff19ed13e78db71d2b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:53:38.628954 14565 consensus_queue.cc:1035] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7410f030c414b53a57f3bb402b093da" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:38.629091 14458 consensus_queue.cc:1035] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c56298a9b5904309bcccc8eba2c2fd54" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:53:38.636374 14560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:38.633992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:38355 (local address 127.3.98.131:37263)
0806 00:53:38.634046 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:38.634048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:38.634222 (+ 174us) server_negotiation.cc:407] Connection header received
0806 00:53:38.634297 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:38.634298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:38.634311 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:38.634370 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:53:38.634499 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.634972 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.635669 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.635887 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.635951 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:38.636140 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:53:38.636176 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:53:38.636230 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:38.636287 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 00:53:38.636310 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:53:38.636626 14585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:38.633942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:37263 (local address 127.3.98.129:38355)
0806 00:53:38.634141 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:38.634153 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:38.634213 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:38.634376 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:38.634377 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:38.634379 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 00:53:38.634432 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:38.634433 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.635037 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.635038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:38.635597 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:38.635598 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:38.635966 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:38.635967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:38.636042 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:38.636047 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 00:53:38.636235 (+ 188us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 00:53:38.636238 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:38.636285 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 00:53:38.636337 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":100,"threads_started":1}
I20260806 00:53:38.642310 13772 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:38.642395 13772 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:53:38.643014 13772 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f7edc46b6a0d42479cf74ce270e4ecda: Sending DeleteTablet for 3 replicas of tablet 843e9d9529244ec98a0cc9a6e352125c
I20260806 00:53:38.643278 14321 tablet_service.cc:1514] Processing DeleteTablet for tablet 843e9d9529244ec98a0cc9a6e352125c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:38 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:54242
I20260806 00:53:38.643271 14136 tablet_service.cc:1514] Processing DeleteTablet for tablet 843e9d9529244ec98a0cc9a6e352125c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:38 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:45322
I20260806 00:53:38.643406 14489 tablet_replica.cc:330] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da: stopping tablet replica
I20260806 00:53:38.643404 13947 tablet_service.cc:1514] Processing DeleteTablet for tablet 843e9d9529244ec98a0cc9a6e352125c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:53:38 UTC) from {username='oryx', principal='oryx/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:34854
I20260806 00:53:38.643467 14489 raft_consensus.cc:2229] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:38.643507 14486 tablet_replica.cc:330] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54: stopping tablet replica
I20260806 00:53:38.643512 14489 raft_consensus.cc:2258] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:38.643551 14486 raft_consensus.cc:2229] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:53:38.643584 14486 raft_consensus.cc:2258] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:38.643587 14488 tablet_replica.cc:330] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0: stopping tablet replica
I20260806 00:53:38.643636 14488 raft_consensus.cc:2229] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:53:38.643697 14488 raft_consensus.cc:2258] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:53:38.643731 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 13868
I20260806 00:53:38.644001 14486 ts_tablet_manager.cc:1905] T 843e9d9529244ec98a0cc9a6e352125c P c56298a9b5904309bcccc8eba2c2fd54: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:38.644356 14488 ts_tablet_manager.cc:1905] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:38.644414 14489 ts_tablet_manager.cc:1905] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:53:38.647338 14488 ts_tablet_manager.cc:1918] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:38.647388 14488 log.cc:1196] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/843e9d9529244ec98a0cc9a6e352125c
I20260806 00:53:38.647475 14489 ts_tablet_manager.cc:1918] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 00:53:38.647526 14489 log.cc:1196] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/843e9d9529244ec98a0cc9a6e352125c
I20260806 00:53:38.647626 14488 ts_tablet_manager.cc:1939] T 843e9d9529244ec98a0cc9a6e352125c P c2dd4a94f1c24ff19ed13e78db71d2b0: Deleting consensus metadata
I20260806 00:53:38.647734 14489 ts_tablet_manager.cc:1939] T 843e9d9529244ec98a0cc9a6e352125c P b7410f030c414b53a57f3bb402b093da: Deleting consensus metadata
I20260806 00:53:38.648058 13759 catalog_manager.cc:4841] TS c2dd4a94f1c24ff19ed13e78db71d2b0 (127.3.98.131:37263): tablet 843e9d9529244ec98a0cc9a6e352125c (table test-table [id=b7dbb70ede4b4a35bbbec2fd85cf9bab]) successfully deleted
I20260806 00:53:38.652241 13756 catalog_manager.cc:4841] TS b7410f030c414b53a57f3bb402b093da (127.3.98.130:38141): tablet 843e9d9529244ec98a0cc9a6e352125c (table test-table [id=b7dbb70ede4b4a35bbbec2fd85cf9bab]) successfully deleted
W20260806 00:53:38.659401 13756 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:44609 (error 108)
I20260806 00:53:38.659749 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 14046
I20260806 00:53:38.660044 14589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:38.659771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:44609 (local address 127.0.0.1:34866)
0806 00:53:38.659943 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:38.659992 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:44609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":127,"threads_started":1}
W20260806 00:53:38.664996 13756 catalog_manager.cc:4584] TS c56298a9b5904309bcccc8eba2c2fd54 (127.3.98.129:44609): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 843e9d9529244ec98a0cc9a6e352125c: Network error: Client connection negotiation failed: client connection to 127.3.98.129:44609: connect: Connection refused (error 111)
I20260806 00:53:38.673056 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 14234
I20260806 00:53:38.682978 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 13735
2026-08-06T00:53:38Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3638 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:38 dist-test-slave-44d2 krb5kdc[14593](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:38 dist-test-slave-44d2 krb5kdc[14593](info): set up 2 sockets
Aug 06 00:53:38 dist-test-slave-44d2 krb5kdc[14593](info): commencing operation
krb5kdc: starting...
W20260806 00:53:39.905966 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:39 dist-test-slave-44d2 krb5kdc[14593](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:53:40.043937 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44325
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:34131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:44325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:40.131301 14607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:40.131556 14607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:40.131595 14607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:40.132803 14607 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:40.133059 14607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:40.133147 14607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:40.133184 14607 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:40.133211 14607 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:40.134965 14607 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:34131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:44325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:40.135277 14607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:40.135530 14607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:40.140812 14615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:40.140812 14616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:40.140854 14620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:40.141366 14607 server_base.cc:1034] running on GCE node
I20260806 00:53:40.141651 14607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:40.142011 14607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:40.143213 14607 hybrid_clock.cc:648] HybridClock initialized: now 1785977620143174 us; error 54 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T00:53:40Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1464 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:40 dist-test-slave-44d2 krb5kdc[14625](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:40 dist-test-slave-44d2 krb5kdc[14625](info): set up 2 sockets
Aug 06 00:53:40 dist-test-slave-44d2 krb5kdc[14625](info): commencing operation
krb5kdc: starting...
W20260806 00:53:41.790390 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.617s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:53:41 dist-test-slave-44d2 krb5kdc[14625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:53:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:53:41.928059 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:41101
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:40413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:41101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:42.013502 14641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:42.013826 14641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:42.013870 14641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:42.015059 14641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:42.015136 14641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:42.015162 14641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:42.015185 14641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:42.015214 14641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:42.016719 14641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:40413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:41101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:41101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:42.017022 14641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:42.017253 14641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:42.022469 14648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:42.022480 14651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:42.022480 14647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:42.022763 14641 server_base.cc:1034] running on GCE node
I20260806 00:53:42.023054 14641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:42.023370 14641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:42.024555 14641 hybrid_clock.cc:648] HybridClock initialized: now 1785977622024539 us; error 56 us; skew 500 ppm
Aug 06 00:53:42 dist-test-slave-44d2 krb5kdc[14625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977622, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:42.027530 14641 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:53:42.028083 14641 webserver.cc:460] Webserver started at http://127.3.98.190:39167/ using document root <none> and password file <none>
I20260806 00:53:42.028369 14641 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:42.028450 14641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:42.028694 14641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:42.029930 14641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "4389be65fd604c4aabf29ab8c8af5d5f"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "6950ac5c9bb2d7c68eb4c490a7941112"
server_key_iv: "ef577d836a088d4a549bd911f258816c"
server_key_version: "encryptionkey@0"
I20260806 00:53:42.030350 14641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "4389be65fd604c4aabf29ab8c8af5d5f"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "6950ac5c9bb2d7c68eb4c490a7941112"
server_key_iv: "ef577d836a088d4a549bd911f258816c"
server_key_version: "encryptionkey@0"
I20260806 00:53:42.031840 14641 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:42.032783 14661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:42.032971 14641 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:42.033097 14641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "4389be65fd604c4aabf29ab8c8af5d5f"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "6950ac5c9bb2d7c68eb4c490a7941112"
server_key_iv: "ef577d836a088d4a549bd911f258816c"
server_key_version: "encryptionkey@0"
I20260806 00:53:42.033185 14641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:42.045954 14641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:42.047925 14641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:42.048100 14641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:42.052963 14641 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:41101
I20260806 00:53:42.053021 14734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:41101 every 8 connection(s)
I20260806 00:53:42.053411 14641 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:42.053695 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 14641
I20260806 00:53:42.053821 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:42.054025 3466 external_mini_cluster.cc:1428] Setting key 437a8676b198fdeca49eeeba8dbe3b38
I20260806 00:53:42.054503 14735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:42.057685 14735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f: Bootstrap starting.
I20260806 00:53:42.058447 14735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:42.058758 14735 log.cc:824] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:42.059533 14735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f: No bootstrap required, opened a new log
Aug 06 00:53:42 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:42.062328 14735 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41101 } }
I20260806 00:53:42.062551 14735 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:42.062636 14735 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4389be65fd604c4aabf29ab8c8af5d5f, State: Initialized, Role: FOLLOWER
I20260806 00:53:42.062844 14735 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41101 } }
I20260806 00:53:42.062973 14735 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:42.063015 14735 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:42.063069 14735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:42.063920 14735 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41101 } }
I20260806 00:53:42.064057 14735 leader_election.cc:302] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4389be65fd604c4aabf29ab8c8af5d5f; no voters:
I20260806 00:53:42.064244 14735 leader_election.cc:288] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:42.064332 14741 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:42.064579 14741 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 1 LEADER]: Becoming Leader. State: Replica: 4389be65fd604c4aabf29ab8c8af5d5f, State: Running, Role: LEADER
I20260806 00:53:42.064656 14735 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:42.064715 14741 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41101 } }
I20260806 00:53:42.065135 14741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4389be65fd604c4aabf29ab8c8af5d5f. Latest consensus state: current_term: 1 leader_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41101 } } }
I20260806 00:53:42.065196 14742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41101 } } }
I20260806 00:53:42.065388 14742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:42.065220 14741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:42.066270 14753 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:42.067036 14738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:42.054606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46756 (local address 127.3.98.190:41101)
0806 00:53:42.054823 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:42.054832 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:42.054866 (+ 34us) server_negotiation.cc:407] Connection header received
0806 00:53:42.055607 (+ 741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:42.055616 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:42.055667 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:42.055859 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:42.056557 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.057574 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.058449 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.059025 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.059159 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:42.062101 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:42.062106 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:42.062106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:42.062120 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:42.064676 (+ 2556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:42.065248 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:42.065251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:42.065252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:42.065468 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:42.065760 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:42.065761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:42.065761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:42.066139 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:42.066504 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:42.066599 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 00:53:42.066775 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":104,"threads_started":1}
I20260806 00:53:42.067065 14753 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:42.069196 14753 catalog_manager.cc:1347] Generated new cluster ID: 78f0bf79cbac4424812b01490b8227c8
I20260806 00:53:42.069262 14753 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:53:42.075626 14753 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:42.076344 14753 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:42.082930 14753 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f: Generated new TSK 0
I20260806 00:53:42.083159 14753 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:53:42.120260 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41101
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:40413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:42.219391 14771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:42.219615 14771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:42.219657 14771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:42.221187 14771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:42.221338 14771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:42.221390 14771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:42.223064 14771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:40413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14771
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:42.223354 14771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:42.223596 14771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:42.230070 14780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:42.230121 14778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:42.230099 14777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:42.230413 14771 server_base.cc:1034] running on GCE node
I20260806 00:53:42.230629 14771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:42.230921 14771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:42.232110 14771 hybrid_clock.cc:648] HybridClock initialized: now 1785977622232089 us; error 34 us; skew 500 ppm
Aug 06 00:53:42 dist-test-slave-44d2 krb5kdc[14625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977622, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:42.234875 14771 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:53:42.235447 14771 webserver.cc:460] Webserver started at http://127.3.98.129:38867/ using document root <none> and password file <none>
I20260806 00:53:42.235958 14771 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:42.236110 14771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:42.236272 14771 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:42.237510 14771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "152d84998ca54ec183ef45a230d60c7e"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "101ca30c759452969ded54ffdce987ce"
server_key_iv: "7d9a33e7dc877e658d8a684f9f3d162f"
server_key_version: "encryptionkey@0"
I20260806 00:53:42.237830 14771 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "152d84998ca54ec183ef45a230d60c7e"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "101ca30c759452969ded54ffdce987ce"
server_key_iv: "7d9a33e7dc877e658d8a684f9f3d162f"
server_key_version: "encryptionkey@0"
I20260806 00:53:42.239151 14771 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 00:53:42.239928 14789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:42.240141 14771 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:42.240255 14771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "152d84998ca54ec183ef45a230d60c7e"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "101ca30c759452969ded54ffdce987ce"
server_key_iv: "7d9a33e7dc877e658d8a684f9f3d162f"
server_key_version: "encryptionkey@0"
I20260806 00:53:42.240334 14771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:42.254514 14771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:42.256955 14771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:42.257128 14771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:42.257373 14771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:42.257691 14771 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:42.257746 14771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:42.257787 14771 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:42.257817 14771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:42.263689 14771 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:45685
I20260806 00:53:42.263760 14936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:45685 every 8 connection(s)
I20260806 00:53:42.264068 14771 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:53:42.267386 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 14771
I20260806 00:53:42.267535 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:42.267776 3466 external_mini_cluster.cc:1428] Setting key 3a3689265fbe78bcb7c77ed5f6c3ade4
Aug 06 00:53:42 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977622, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:42.276446 14738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:42.264783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:44371 (local address 127.3.98.190:41101)
0806 00:53:42.264836 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:42.264839 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:42.265157 (+ 318us) server_negotiation.cc:407] Connection header received
0806 00:53:42.265720 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:42.265722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:42.265734 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:42.265787 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:42.266862 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.267391 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.268931 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.269145 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.269219 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:42.272332 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:42.272335 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:42.272335 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:42.272344 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:42.274412 (+ 2068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:42.275009 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:42.275011 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:42.275011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:42.275072 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:42.275403 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:42.275404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:42.275404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:42.275565 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:42.275644 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:42.276113 (+ 469us) server_negotiation.cc:299] Negotiation successful
0806 00:53:42.276275 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 00:53:42.276563 14940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:42.264799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:44371)
0806 00:53:42.265007 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:42.265058 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:42.265626 (+ 568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:42.265851 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:42.265854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:42.266511 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:42.266772 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:42.266778 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.267518 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.267520 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:42.268804 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:42.268807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.269245 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.269246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:42.269409 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:42.270027 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:42.270039 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:42.272146 (+ 2107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:42.274510 (+ 2364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:42.274520 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:42.274522 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:42.274894 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:42.275153 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:42.275154 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:42.275154 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:42.275322 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:42.275656 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:42.275665 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:42.275877 (+ 212us) client_negotiation.cc:769] Sending connection context
0806 00:53:42.276047 (+ 170us) client_negotiation.cc:240] Negotiation successful
0806 00:53:42.276259 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":120,"threads_started":1}
I20260806 00:53:42.277220 14938 heartbeater.cc:347] Connected to a master server at 127.3.98.190:41101
I20260806 00:53:42.277343 14938 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:42.277557 14938 heartbeater.cc:511] Master 127.3.98.190:41101 requested a full tablet report, sending...
I20260806 00:53:42.278200 14683 ts_manager.cc:194] Registered new tserver with Master: 152d84998ca54ec183ef45a230d60c7e (127.3.98.129:45685)
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
I20260806 00:53:42.279181 14683 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:44371
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:53:42.297071 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41101
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:40413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:42.382973 14946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:42.383241 14946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:42.383281 14946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:42.384442 14946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:42.384545 14946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:42.384593 14946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:42.386099 14946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:40413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:42.386415 14946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:42.386673 14946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:42.391968 14957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:42.391971 14954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:42.391991 14952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:42.392421 14946 server_base.cc:1034] running on GCE node
I20260806 00:53:42.392731 14946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:42.393015 14946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:42.394189 14946 hybrid_clock.cc:648] HybridClock initialized: now 1785977622394173 us; error 27 us; skew 500 ppm
Aug 06 00:53:42 dist-test-slave-44d2 krb5kdc[14625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977622, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:42.396783 14946 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:53:42.397257 14946 webserver.cc:460] Webserver started at http://127.3.98.130:43349/ using document root <none> and password file <none>
I20260806 00:53:42.397516 14946 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:42.397588 14946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:42.397745 14946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:42.398852 14946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "fc67ad52ec2042f0b4051160e2d275e9"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "6c9a7ce909d3714d3175d2c65f117cdd"
server_key_iv: "8717087b78687b1bb91edd76e57b57a1"
server_key_version: "encryptionkey@0"
I20260806 00:53:42.399236 14946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "fc67ad52ec2042f0b4051160e2d275e9"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "6c9a7ce909d3714d3175d2c65f117cdd"
server_key_iv: "8717087b78687b1bb91edd76e57b57a1"
server_key_version: "encryptionkey@0"
I20260806 00:53:42.400692 14946 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260806 00:53:42.401531 14967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:42.401714 14946 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:42.401818 14946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "fc67ad52ec2042f0b4051160e2d275e9"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "6c9a7ce909d3714d3175d2c65f117cdd"
server_key_iv: "8717087b78687b1bb91edd76e57b57a1"
server_key_version: "encryptionkey@0"
I20260806 00:53:42.401964 14946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:42.420929 14946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:42.422849 14946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:42.423035 14946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:42.423329 14946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:42.423761 14946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:42.423825 14946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:42.423856 14946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:42.423877 14946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:42.430177 14946 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:34933
I20260806 00:53:42.430220 15123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:34933 every 8 connection(s)
I20260806 00:53:42.430565 14946 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:42.432966 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 14946
I20260806 00:53:42.433080 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:42.433313 3466 external_mini_cluster.cc:1428] Setting key 46b056c323f95b671b5ff8ec753b56f7
Aug 06 00:53:42 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977622, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:42.441038 14738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:42.431307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:54241 (local address 127.3.98.190:41101)
0806 00:53:42.431367 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:42.431370 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:42.431601 (+ 231us) server_negotiation.cc:407] Connection header received
0806 00:53:42.432040 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:42.432042 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:42.432054 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:42.432118 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:42.433233 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.433979 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.435043 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.435356 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.435435 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:42.438099 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:42.438101 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:42.438101 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:42.438109 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:42.439583 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:42.440021 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:42.440022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:42.440023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:42.440086 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:42.440352 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:42.440353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:42.440353 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:42.440475 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:42.440580 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:42.440860 (+ 280us) server_negotiation.cc:299] Negotiation successful
0806 00:53:42.440939 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":32}
I20260806 00:53:42.441246 15126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:42.431246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:54241)
0806 00:53:42.431417 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:42.431460 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:42.431955 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:42.432184 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:42.432188 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:42.432841 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:42.433117 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:42.433124 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.434090 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.434091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:42.434922 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:42.434924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.435472 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.435478 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:42.435616 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:42.436293 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:42.436307 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:42.438001 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:42.439688 (+ 1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:42.439697 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:42.439699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:42.439936 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:42.440167 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:42.440167 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:42.440168 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:42.440278 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:42.440571 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:42.440579 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:42.440720 (+ 141us) client_negotiation.cc:769] Sending connection context
0806 00:53:42.440827 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 00:53:42.441002 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
I20260806 00:53:42.441735 15124 heartbeater.cc:347] Connected to a master server at 127.3.98.190:41101
I20260806 00:53:42.441833 15124 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:42.442035 15124 heartbeater.cc:511] Master 127.3.98.190:41101 requested a full tablet report, sending...
I20260806 00:53:42.442461 14683 ts_manager.cc:194] Registered new tserver with Master: fc67ad52ec2042f0b4051160e2d275e9 (127.3.98.130:34933)
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
I20260806 00:53:42.442981 14683 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:54241
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:53:42.460978 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41101
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:40413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:42.545831 15129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:42.546118 15129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:42.546147 15129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:42.547328 15129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:42.547369 15129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:42.547395 15129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:42.548853 15129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:40413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:41101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:42.549091 15129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:42.549341 15129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:42.554563 15146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:42.554563 15142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:42.554592 15141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:42.554909 15129 server_base.cc:1034] running on GCE node
I20260806 00:53:42.555140 15129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:42.555416 15129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:42.556548 15129 hybrid_clock.cc:648] HybridClock initialized: now 1785977622556517 us; error 36 us; skew 500 ppm
Aug 06 00:53:42 dist-test-slave-44d2 krb5kdc[14625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977622, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:42.559345 15129 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:53:42.559834 15129 webserver.cc:460] Webserver started at http://127.3.98.131:44905/ using document root <none> and password file <none>
I20260806 00:53:42.560082 15129 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:42.560130 15129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:42.560273 15129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:42.561452 15129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "1c5a47294af24fa28b0340b931aee231"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "28a6758eb310ebde987c45edc6dd0612"
server_key_iv: "664d3e734a02d4e9ed97b2da92ac32bb"
server_key_version: "encryptionkey@0"
I20260806 00:53:42.561841 15129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "1c5a47294af24fa28b0340b931aee231"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "28a6758eb310ebde987c45edc6dd0612"
server_key_iv: "664d3e734a02d4e9ed97b2da92ac32bb"
server_key_version: "encryptionkey@0"
I20260806 00:53:42.563282 15129 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:42.564043 15153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:42.564337 15129 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:42.564414 15129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "1c5a47294af24fa28b0340b931aee231"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "28a6758eb310ebde987c45edc6dd0612"
server_key_iv: "664d3e734a02d4e9ed97b2da92ac32bb"
server_key_version: "encryptionkey@0"
I20260806 00:53:42.564540 15129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:42.575001 15129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:42.577013 15129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:42.577134 15129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:42.577316 15129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:42.577648 15129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:42.577683 15129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:42.577705 15129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:42.577759 15129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:42.584443 15129 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:34771
I20260806 00:53:42.584622 15296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:34771 every 8 connection(s)
I20260806 00:53:42.584892 15129 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:42.586782 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 15129
I20260806 00:53:42.586925 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:42.587152 3466 external_mini_cluster.cc:1428] Setting key 028c5fa4993ac1f4b2566fc7ecf72c38
Aug 06 00:53:42 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977622, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:53:42.597728 14738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:42.585759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:39617 (local address 127.3.98.190:41101)
0806 00:53:42.585852 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:42.585855 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:42.586153 (+ 298us) server_negotiation.cc:407] Connection header received
0806 00:53:42.586824 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:42.586826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:42.586842 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:42.586955 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:42.588625 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.589579 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.591188 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.591543 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.591597 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:42.594689 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:42.594690 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:42.594691 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:42.594716 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:42.596167 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:42.596761 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:42.596762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:42.596763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:42.596821 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:42.597111 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:42.597112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:42.597112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:42.597221 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:42.597274 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:42.597589 (+ 315us) server_negotiation.cc:299] Negotiation successful
0806 00:53:42.597657 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260806 00:53:42.597949 15299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:42.585720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:39617)
0806 00:53:42.585971 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:42.586022 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:42.586678 (+ 656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:42.587139 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:42.587145 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:42.588088 (+ 943us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:42.588438 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:42.588454 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.589705 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.589707 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:42.591074 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:42.591077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:42.591700 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:42.591701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:42.591866 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:42.592567 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:42.592600 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:42.594605 (+ 2005us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:42.596275 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:42.596284 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:42.596287 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:42.596690 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:42.596896 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:53:42.596897 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:53:42.596898 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:53:42.597038 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:53:42.597305 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:42.597311 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:42.597435 (+ 124us) client_negotiation.cc:769] Sending connection context
0806 00:53:42.597554 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 00:53:42.597686 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":118,"threads_started":1}
I20260806 00:53:42.598484 15297 heartbeater.cc:347] Connected to a master server at 127.3.98.190:41101
I20260806 00:53:42.598604 15297 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:42.598835 15297 heartbeater.cc:511] Master 127.3.98.190:41101 requested a full tablet report, sending...
I20260806 00:53:42.599242 14683 ts_manager.cc:194] Registered new tserver with Master: 1c5a47294af24fa28b0340b931aee231 (127.3.98.131:34771)
I20260806 00:53:42.599635 14683 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:39617
I20260806 00:53:42.610095 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab.
Entry for principal oryx/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab.
WARNING: no policy specified for oryx/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab.
Entry for principal oryx/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab.
WARNING: no policy specified for oryx/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab.
Entry for principal oryx/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab.
I20260806 00:53:42.698788 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 14771
I20260806 00:53:42.712378 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 14946
I20260806 00:53:42.733608 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 15129
I20260806 00:53:42.757405 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 14641
I20260806 00:53:42.767971 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:41101
--webserver_interface=127.3.98.190
--webserver_port=39167
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:40413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:41101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:53:42.855207 15310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:42.855422 15310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:42.855444 15310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:42.856637 15310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:42.856683 15310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:42.856696 15310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:42.856709 15310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:42.856753 15310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:42.858265 15310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:40413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:41101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:41101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=39167
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:42.858539 15310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:42.858785 15310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:42.863814 15318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:42.863867 15317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:42.863879 15321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:42.864049 15310 server_base.cc:1034] running on GCE node
I20260806 00:53:42.864322 15310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:42.864660 15310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:42.865865 15310 hybrid_clock.cc:648] HybridClock initialized: now 1785977622865847 us; error 28 us; skew 500 ppm
Aug 06 00:53:42 dist-test-slave-44d2 krb5kdc[14625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977622, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:42.869189 15310 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:53:42.869724 15310 webserver.cc:460] Webserver started at http://127.3.98.190:39167/ using document root <none> and password file <none>
I20260806 00:53:42.870009 15310 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:42.870148 15310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:42.871811 15310 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:42.872570 15331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:42.872782 15310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:42.872887 15310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "4389be65fd604c4aabf29ab8c8af5d5f"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "6950ac5c9bb2d7c68eb4c490a7941112"
server_key_iv: "ef577d836a088d4a549bd911f258816c"
server_key_version: "encryptionkey@0"
I20260806 00:53:42.873320 15310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:42.906886 15310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:42.909638 15310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:42.909832 15310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:42.914414 15310 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:41101
I20260806 00:53:42.914450 15410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:41101 every 8 connection(s)
I20260806 00:53:42.914872 15310 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:42.916587 15411 sys_catalog.cc:263] Verifying existing consensus state
I20260806 00:53:42.917310 15411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f: Bootstrap starting.
I20260806 00:53:42.924592 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 15310
I20260806 00:53:42.924973 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:45685
--local_ip_for_outbound_sockets=127.3.98.129
--tserver_master_addrs=127.3.98.190:41101
--webserver_port=38867
--webserver_interface=127.3.98.129
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:40413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.3.98.129
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:53:42.927459 15411 log.cc:824] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:42.929330 15411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 00:53:42.929680 15411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f: Bootstrap complete.
I20260806 00:53:42.932080 15411 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41101 } }
I20260806 00:53:42.932312 15411 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4389be65fd604c4aabf29ab8c8af5d5f, State: Initialized, Role: FOLLOWER
I20260806 00:53:42.932543 15411 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41101 } }
I20260806 00:53:42.932637 15411 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:42.932669 15411 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:42.932740 15411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 1 FOLLOWER]: Advancing to term 2
I20260806 00:53:42.933755 15411 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41101 } }
I20260806 00:53:42.933843 15411 leader_election.cc:302] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4389be65fd604c4aabf29ab8c8af5d5f; no voters:
I20260806 00:53:42.934060 15411 leader_election.cc:288] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 00:53:42.934104 15418 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 2 FOLLOWER]: Leader election won for term 2
I20260806 00:53:42.934237 15418 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [term 2 LEADER]: Becoming Leader. State: Replica: 4389be65fd604c4aabf29ab8c8af5d5f, State: Running, Role: LEADER
I20260806 00:53:42.934326 15418 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41101 } }
I20260806 00:53:42.934360 15411 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:42.934636 15419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4389be65fd604c4aabf29ab8c8af5d5f. Latest consensus state: current_term: 2 leader_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41101 } } }
I20260806 00:53:42.934923 15419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:42.934829 15422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4389be65fd604c4aabf29ab8c8af5d5f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41101 } } }
I20260806 00:53:42.935243 15437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:42.935233 15422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:42.935842 15437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:42.936187 15437 catalog_manager.cc:1259] Loaded cluster ID: 78f0bf79cbac4424812b01490b8227c8
I20260806 00:53:42.936239 15437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:53:42.937624 15437 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:42.937800 15437 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4389be65fd604c4aabf29ab8c8af5d5f: Loaded TSK: 0
I20260806 00:53:42.938025 15437 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 00:53:43.013684 15416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:43.013890 15416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:43.013916 15416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:43.015103 15416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:43.015147 15416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:43.015174 15416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:43.016695 15416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:40413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.129.keytab
--principal=oryx/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:45685
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=38867
--tserver_master_addrs=127.3.98.190:41101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:43.016935 15416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:43.017184 15416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:43.023459 15456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:43.023540 15416 server_base.cc:1034] running on GCE node
W20260806 00:53:43.023651 15453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:43.023655 15458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:43.023968 15416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:43.024263 15416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:43.025449 15416 hybrid_clock.cc:648] HybridClock initialized: now 1785977623025405 us; error 57 us; skew 500 ppm
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977623, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:43.028291 15416 init.cc:377] Logged in from keytab as oryx/127.3.98.129@KRBTEST.COM (short username oryx)
I20260806 00:53:43.028972 15416 webserver.cc:460] Webserver started at http://127.3.98.129:38867/ using document root <none> and password file <none>
I20260806 00:53:43.029241 15416 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:43.029309 15416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:43.030876 15416 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:53:43.031582 15468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:43.031802 15416 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:43.031915 15416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "152d84998ca54ec183ef45a230d60c7e"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "101ca30c759452969ded54ffdce987ce"
server_key_iv: "7d9a33e7dc877e658d8a684f9f3d162f"
server_key_version: "encryptionkey@0"
I20260806 00:53:43.032397 15416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:43.044251 15416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:43.046886 15416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:43.047051 15416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:43.047329 15416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:43.047720 15416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:43.047771 15416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:43.047804 15416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:43.047835 15416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:43.055503 15416 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:45685
I20260806 00:53:43.055596 15619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:45685 every 8 connection(s)
I20260806 00:53:43.055970 15416 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:53:43.061694 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 15416
I20260806 00:53:43.062024 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:34933
--local_ip_for_outbound_sockets=127.3.98.130
--tserver_master_addrs=127.3.98.190:41101
--webserver_port=43349
--webserver_interface=127.3.98.130
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:40413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.3.98.130
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:43.066479 15622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:43.056836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:44151)
0806 00:53:43.057070 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:43.057123 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:43.057627 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:43.058106 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:43.058109 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:43.058696 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:43.058889 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.058894 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.060595 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.060596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.061388 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.061390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.062345 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.062346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.062487 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.063131 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:43.063141 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:43.066218 (+ 3077us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":87,"threads_started":1}
W20260806 00:53:43.066717 15620 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:41101 (0 consecutive failures): Not authorized: Failed to ping master at 127.3.98.190:41101: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
W20260806 00:53:43.067024 15623 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:43.056907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:44151 (local address 127.3.98.190:41101)
0806 00:53:43.057165 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:43.057174 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:43.057221 (+ 47us) server_negotiation.cc:407] Connection header received
0806 00:53:43.057844 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:43.057852 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:43.057907 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:43.058047 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:43.059013 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.060436 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.061479 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.062139 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.062247 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.066438 (+ 4191us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:44151: BlockingRecv error: recv got EOF from 127.3.98.129:44151 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":146,"threads_started":1}
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:43.073400 15622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:43.067012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:55185)
0806 00:53:43.067309 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:43.067321 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:43.067379 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:43.067585 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:43.067586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:43.067751 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:43.067817 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.067820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.068900 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.068901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.069755 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.069757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.070299 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.070300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.070371 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.070910 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:43.070916 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:43.073294 (+ 2378us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":276}
W20260806 00:53:43.073482 15623 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:43.067226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:55185 (local address 127.3.98.190:41101)
0806 00:53:43.067291 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:43.067294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:43.067379 (+ 85us) server_negotiation.cc:407] Connection header received
0806 00:53:43.067440 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:43.067441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:43.067455 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:43.067524 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:43.067920 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.068811 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.069854 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.070203 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.070279 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.073422 (+ 3143us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:55185: BlockingRecv error: recv got EOF from 127.3.98.129:55185 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:43.079561 15622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:43.074044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:50797)
0806 00:53:43.074090 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:43.074101 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:43.074136 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:43.074296 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:43.074297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:43.074438 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:43.074473 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.074475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.075448 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.075449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.076299 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.076302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.076913 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.076914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.076984 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.077460 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:43.077466 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:43.079481 (+ 2015us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 00:53:43.079624 15623 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:43.074116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:50797 (local address 127.3.98.190:41101)
0806 00:53:43.074163 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:43.074165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:43.074175 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:43.074199 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:43.074200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:43.074212 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:43.074282 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:43.074558 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.075352 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.076400 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.076813 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.076913 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.079563 (+ 2650us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:50797: BlockingRecv error: recv got EOF from 127.3.98.129:50797 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260806 00:53:43.079701 15620 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 00:53:43.155921 15625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:43.156154 15625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:43.156179 15625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:43.157419 15625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:43.157466 15625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:43.157493 15625 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:43.158891 15625 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:40413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.130.keytab
--principal=oryx/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:34933
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=43349
--tserver_master_addrs=127.3.98.190:41101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15625
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:43.159107 15625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:43.159304 15625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 00:53:43.164641 15625 server_base.cc:1034] running on GCE node
W20260806 00:53:43.164628 15636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:43.164628 15631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:43.164624 15633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:43.165043 15625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:43.165251 15625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:43.166427 15625 hybrid_clock.cc:648] HybridClock initialized: now 1785977623166402 us; error 36 us; skew 500 ppm
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977623, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:43.169076 15625 init.cc:377] Logged in from keytab as oryx/127.3.98.130@KRBTEST.COM (short username oryx)
I20260806 00:53:43.169586 15625 webserver.cc:460] Webserver started at http://127.3.98.130:43349/ using document root <none> and password file <none>
I20260806 00:53:43.169819 15625 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:43.169907 15625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:43.171279 15625 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:43.172149 15651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:43.172343 15625 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:43.172452 15625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "fc67ad52ec2042f0b4051160e2d275e9"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "6c9a7ce909d3714d3175d2c65f117cdd"
server_key_iv: "8717087b78687b1bb91edd76e57b57a1"
server_key_version: "encryptionkey@0"
I20260806 00:53:43.172858 15625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:43.198645 15625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:43.200704 15625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:43.200870 15625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:43.201133 15625 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:43.201467 15625 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:43.201524 15625 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:43.201570 15625 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:43.201594 15625 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:43.208384 15625 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:34933
I20260806 00:53:43.208426 15798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:34933 every 8 connection(s)
I20260806 00:53:43.208884 15625 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:43.209619 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 15625
I20260806 00:53:43.209970 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:34771
--local_ip_for_outbound_sockets=127.3.98.131
--tserver_master_addrs=127.3.98.190:41101
--webserver_port=44905
--webserver_interface=127.3.98.131
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:40413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.3.98.131
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:43.217638 15803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:43.209639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:52861)
0806 00:53:43.209852 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:43.209904 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:43.210688 (+ 784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:43.210981 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:43.210987 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:43.212020 (+ 1033us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:43.212265 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.212271 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.213084 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.213085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.213922 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.213924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.214428 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.214429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.214547 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.215147 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:43.215156 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:43.217482 (+ 2326us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":98,"threads_started":1}
W20260806 00:53:43.217695 15623 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:43.209659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:52861 (local address 127.3.98.190:41101)
0806 00:53:43.209749 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:43.209751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:43.209989 (+ 238us) server_negotiation.cc:407] Connection header received
0806 00:53:43.210816 (+ 827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:43.210817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:43.210833 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:43.210899 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:43.212382 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.212982 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.214017 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.214321 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.214402 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.217607 (+ 3205us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:52861: BlockingRecv error: recv got EOF from 127.3.98.130:52861 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260806 00:53:43.217944 15799 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:41101 (0 consecutive failures): Not authorized: Failed to ping master at 127.3.98.190:41101: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:43.222695 15803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:43.218251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:53997)
0806 00:53:43.218304 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:43.218312 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:43.218363 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:43.218595 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:43.218597 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:43.218725 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:43.218768 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.218770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.219399 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.219400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.219900 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.219902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.220320 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.220321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.220391 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.220843 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:43.220848 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:43.222614 (+ 1766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 00:53:43.222751 15623 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:43.218312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:53997 (local address 127.3.98.190:41101)
0806 00:53:43.218378 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:43.218380 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:43.218388 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:53:43.218426 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:43.218427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:43.218436 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:43.218567 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:43.218854 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.219317 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.220044 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.220234 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.220319 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.222686 (+ 2367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:53997: BlockingRecv error: recv got EOF from 127.3.98.130:53997 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:43.227350 15803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:43.223105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:43579)
0806 00:53:43.223152 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:43.223163 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:43.223200 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:43.223307 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:43.223308 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:43.223435 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:43.223462 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.223464 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.224083 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.224084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.224646 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.224647 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.225013 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.225014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.225068 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.225481 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:43.225486 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:43.227278 (+ 1792us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 00:53:43.227530 15799 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 00:53:43.227545 15623 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:43.223165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:43579 (local address 127.3.98.190:41101)
0806 00:53:43.223207 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:43.223209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:43.223219 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:43.223252 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:43.223253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:43.223262 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:43.223306 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:43.223543 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.224000 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.224739 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.224925 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.225012 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.227377 (+ 2365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:43579: BlockingRecv error: recv got EOF from 127.3.98.130:43579 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260806 00:53:43.298719 15804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:43.298940 15804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:43.298965 15804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:43.300089 15804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:43.300127 15804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:43.300153 15804 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:43.301553 15804 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:40413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/krb5kdc/oryx_127.3.98.131.keytab
--principal=oryx/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:34771
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=44905
--tserver_master_addrs=127.3.98.190:41101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:43.301740 15804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:43.301925 15804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:43.307446 15815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:43.307430 15816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:43.307425 15818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:43.307651 15804 server_base.cc:1034] running on GCE node
I20260806 00:53:43.307917 15804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:43.308169 15804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:43.309373 15804 hybrid_clock.cc:648] HybridClock initialized: now 1785977623309345 us; error 36 us; skew 500 ppm
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977623, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:53:43.312093 15804 init.cc:377] Logged in from keytab as oryx/127.3.98.131@KRBTEST.COM (short username oryx)
I20260806 00:53:43.312654 15804 webserver.cc:460] Webserver started at http://127.3.98.131:44905/ using document root <none> and password file <none>
I20260806 00:53:43.312897 15804 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:43.312983 15804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:43.314426 15804 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 00:53:43.315078 15828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:43.315235 15804 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:43.315340 15804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "1c5a47294af24fa28b0340b931aee231"
format_stamp: "Formatted at 2026-08-06 00:53:42 on dist-test-slave-44d2"
server_key: "28a6758eb310ebde987c45edc6dd0612"
server_key_iv: "664d3e734a02d4e9ed97b2da92ac32bb"
server_key_version: "encryptionkey@0"
I20260806 00:53:43.315697 15804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:43.333191 15804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:43.335709 15804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:43.335829 15804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:43.336014 15804 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:43.336421 15804 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:43.336457 15804 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:43.336521 15804 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:43.336549 15804 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:43.342502 15804 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:34771
I20260806 00:53:43.342599 15987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:34771 every 8 connection(s)
I20260806 00:53:43.342936 15804 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:43.347860 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 15804
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 00:53:43.351317 15623 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:43.343770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:36095 (local address 127.3.98.190:41101)
0806 00:53:43.343845 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:43.343848 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:43.344049 (+ 201us) server_negotiation.cc:407] Connection header received
0806 00:53:43.344684 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:43.344685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:43.344700 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:43.344766 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:43.345785 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.346295 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.347357 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.347567 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.347658 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.351251 (+ 3593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:36095: BlockingRecv error: recv got EOF from 127.3.98.131:36095 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 00:53:43.351336 15991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:43.343729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:36095)
0806 00:53:43.343886 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:43.343935 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:43.344564 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:43.344845 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:43.344849 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:43.345455 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:43.345663 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.345668 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.346401 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.346402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.347250 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.347252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.347681 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.347682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.347824 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.348538 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:43.348555 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:43.351139 (+ 2584us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":68,"threads_started":1}
W20260806 00:53:43.351624 15988 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:41101 (0 consecutive failures): Not authorized: Failed to ping master at 127.3.98.190:41101: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:43.356520 15993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:43.348463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46760 (local address 127.3.98.190:41101)
0806 00:53:43.348663 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:43.348665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:43.348675 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:43.348700 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:43.348701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:43.348715 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:43.348796 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:43.349483 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.350052 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.351179 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.351511 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.351592 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.353125 (+ 1533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:43.353130 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:43.353130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:53:43.353141 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:43.354870 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:43.355294 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:43.355304 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:43.355305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:43.355411 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:53:43.355646 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:53:43.355647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:53:43.355648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:53:43.355987 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:43.356148 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:43.356258 (+ 110us) server_negotiation.cc:299] Negotiation successful
0806 00:53:43.356379 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":115,"threads_started":1}
I20260806 00:53:43.356630 15991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:43.351890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:39647)
0806 00:53:43.351969 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:43.351978 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:43.352011 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:43.352143 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:43.352145 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:43.352314 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:43.352380 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.352383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.353055 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.353056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.353730 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.353732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.354202 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.354203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.354258 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.354707 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:43.354711 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:43.356534 (+ 1823us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":56}
W20260806 00:53:43.356658 15623 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:43.351920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:39647 (local address 127.3.98.190:41101)
0806 00:53:43.351989 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:43.351991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:43.352004 (+ 13us) server_negotiation.cc:407] Connection header received
0806 00:53:43.352053 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:43.352053 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:43.352064 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:43.352130 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:43.352459 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.352972 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.353812 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.354116 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.354186 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.356612 (+ 2426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:39647: BlockingRecv error: recv got EOF from 127.3.98.131:39647 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:43 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:43.361195 15991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:43.357023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:48037)
0806 00:53:43.357093 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:43.357106 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:43.357154 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:43.357295 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:43.357295 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:43.357440 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:43.357469 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.357470 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.358105 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.358106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.358570 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:43.358572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.358989 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.358990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:43.359026 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.359400 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:43.359404 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:43.361113 (+ 1709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260806 00:53:43.361263 15993 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:43.357091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:48037 (local address 127.3.98.190:41101)
0806 00:53:43.357140 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:43.357141 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:43.357150 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:53:43.357207 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:43.357208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:43.357220 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:43.357280 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:43.357532 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.358039 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.358655 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:43.358845 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:43.358980 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:43.361187 (+ 2207us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:48037: BlockingRecv error: recv got EOF from 127.3.98.131:48037 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260806 00:53:43.361357 15988 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 00:53:44 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:44 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:44.084966 15994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:44.080124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:59933)
0806 00:53:44.080278 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:44.080292 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:44.080384 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:44.080577 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:44.080578 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:44.080816 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:44.080880 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:44.080882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:44.081538 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:44.081539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:44.082125 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:44.082128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:44.082458 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:44.082459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:44.082501 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:44.082983 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:44.082988 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:44.084891 (+ 1903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":76,"threads_started":1}
W20260806 00:53:44.085103 15997 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:44.080166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:59933 (local address 127.3.98.190:41101)
0806 00:53:44.080305 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:44.080307 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:44.080353 (+ 46us) server_negotiation.cc:407] Connection header received
0806 00:53:44.080452 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:44.080453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:44.080469 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:44.080563 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:44.080963 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:44.081466 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:44.082203 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:44.082393 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:44.082444 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:44.084995 (+ 2551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:59933: BlockingRecv error: recv got EOF from 127.3.98.129:59933 (error 108)
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":59,"threads_started":1}
Aug 06 00:53:44 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:44 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 00:53:44.233884 15997 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:44.228051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:37347 (local address 127.3.98.190:41101)
0806 00:53:44.228157 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:44.228159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:44.228251 (+ 92us) server_negotiation.cc:407] Connection header received
0806 00:53:44.228443 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:44.228444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:44.228463 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:44.228549 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:44.228922 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:44.229465 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:44.230532 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:44.230760 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:44.230855 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:44.233827 (+ 2972us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:37347: BlockingRecv error: recv got EOF from 127.3.98.130:37347 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 00:53:44.233919 15998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:44.227963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:37347)
0806 00:53:44.228158 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:44.228172 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:44.228273 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:44.228558 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:44.228560 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:44.228774 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:44.228826 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:44.228828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:44.229734 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:44.229737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:44.230428 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:44.230432 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:44.230862 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:44.230863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:44.230930 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:44.231476 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:44.231483 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:44.233741 (+ 2258us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":100,"threads_started":1}
Aug 06 00:53:44 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:44 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:44.366822 15999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:44.361847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:33695)
0806 00:53:44.362000 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:44.362014 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:44.362090 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:44.362245 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:44.362246 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:44.362414 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:44.362468 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:44.362470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:44.363138 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:44.363139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:44.363681 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:44.363683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:44.364244 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:44.364245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:44.364315 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:44.364863 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:44.364869 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:44.366756 (+ 1887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":94,"threads_started":1}
W20260806 00:53:44.366981 15997 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:44.361915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:33695 (local address 127.3.98.190:41101)
0806 00:53:44.362022 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:44.362025 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:44.362071 (+ 46us) server_negotiation.cc:407] Connection header received
0806 00:53:44.362157 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:44.362158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:44.362170 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:44.362223 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:44.362536 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:44.363067 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:44.363801 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:44.364163 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:44.364232 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:44.366887 (+ 2655us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:33695: BlockingRecv error: recv got EOF from 127.3.98.131:33695 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 06 00:53:45 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:45 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:45.090721 16001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:45.085600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:41341)
0806 00:53:45.085747 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:45.085761 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:45.085933 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:45.086148 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:45.086151 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:45.086427 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:45.086489 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:45.086492 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:45.087208 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:45.087209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:45.087759 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:45.087761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:45.088173 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:45.088174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:45.088237 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:45.088769 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:45.088774 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:45.090661 (+ 1887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
W20260806 00:53:45.090881 16003 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:45.085746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:41341 (local address 127.3.98.190:41101)
0806 00:53:45.085919 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:45.085921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:45.085931 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:45.086022 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:45.086022 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:45.086036 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:45.086121 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:45.086585 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:45.087107 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:45.087853 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:45.088071 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:45.088175 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:45.090784 (+ 2609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:41341: BlockingRecv error: recv got EOF from 127.3.98.129:41341 (error 108)
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":104,"threads_started":1}
Aug 06 00:53:45 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:45 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:45.243053 16004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:45.234429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:59699)
0806 00:53:45.234584 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:45.234594 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:45.234653 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:45.234826 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:45.234828 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:45.235022 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:45.235077 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:45.235079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:45.235773 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:45.235774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:45.236366 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:45.236368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:45.236808 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:45.236809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:45.236857 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:45.241162 (+ 4305us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:45.241168 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:45.242993 (+ 1825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":93,"threads_started":1}
W20260806 00:53:45.243188 16003 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:45.234519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:59699 (local address 127.3.98.190:41101)
0806 00:53:45.234588 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:45.234590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:45.234637 (+ 47us) server_negotiation.cc:407] Connection header received
0806 00:53:45.234699 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:45.234700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:45.234712 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:45.234767 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:45.235155 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:45.235704 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:45.236441 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:45.236706 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:45.236806 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:45.243105 (+ 6299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:59699: BlockingRecv error: recv got EOF from 127.3.98.130:59699 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 06 00:53:45 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:45 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:45.372365 16006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:45.367335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:44803)
0806 00:53:45.367569 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:45.367584 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:45.367675 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:45.367839 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:45.367840 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:45.368027 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:45.368078 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:45.368080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:45.368832 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:45.368833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:45.369399 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:45.369402 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:45.369812 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:45.369814 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:45.369877 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:45.370416 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:45.370421 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:45.372297 (+ 1876us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":63,"threads_started":1}
W20260806 00:53:45.372478 16003 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:45.367501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:44803 (local address 127.3.98.190:41101)
0806 00:53:45.367573 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:45.367575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:45.367654 (+ 79us) server_negotiation.cc:407] Connection header received
0806 00:53:45.367740 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:45.367741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:45.367755 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:45.367829 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:45.368169 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:45.368741 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:45.369514 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:45.369722 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:45.369801 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:45.372391 (+ 2590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:44803: BlockingRecv error: recv got EOF from 127.3.98.131:44803 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 06 00:53:46 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:46 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:46.096481 16007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:46.091275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:41601)
0806 00:53:46.091466 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:46.091477 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:46.091549 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:46.091715 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:46.091716 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:46.091888 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:46.091941 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:46.091942 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:46.092613 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:46.092614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:46.093160 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:46.093162 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:46.093492 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:46.093493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:46.093533 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:46.094111 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:46.094119 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:46.096406 (+ 2287us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":108,"threads_started":1}
W20260806 00:53:46.096679 16008 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:46.091378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:41601 (local address 127.3.98.190:41101)
0806 00:53:46.091494 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:46.091498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:46.091531 (+ 33us) server_negotiation.cc:407] Connection header received
0806 00:53:46.091617 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:46.091618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:46.091629 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:46.091690 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:46.092013 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:46.092540 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:46.093233 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:46.093423 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:46.093474 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:46.096585 (+ 3111us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:41601: BlockingRecv error: recv got EOF from 127.3.98.129:41601 (error 108)
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":57,"threads_started":1}
Aug 06 00:53:46 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:46 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:46.248579 16010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:46.243669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:50677)
0806 00:53:46.243811 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:46.243821 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:46.243883 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:46.244043 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:46.244044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:46.244221 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:46.244275 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:46.244277 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:46.245062 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:46.245063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:46.245633 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:46.245635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:46.245970 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:46.245971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:46.246017 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:46.246517 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:46.246522 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:46.248455 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
W20260806 00:53:46.248687 16008 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:46.243742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:50677 (local address 127.3.98.190:41101)
0806 00:53:46.243793 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:46.243799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:46.243863 (+ 64us) server_negotiation.cc:407] Connection header received
0806 00:53:46.243930 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:46.243931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:46.243941 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:46.243999 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:46.244349 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:46.244994 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:46.245710 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:46.245899 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:46.245953 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:46.248596 (+ 2643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:50677: BlockingRecv error: recv got EOF from 127.3.98.130:50677 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 06 00:53:46 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:46 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:46.380923 16011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:46.372857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:59835)
0806 00:53:46.372983 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:46.372997 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:46.373078 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:46.373303 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:46.373305 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:46.373537 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:46.373600 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:46.373603 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:46.374522 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:46.374523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:46.375460 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:46.375463 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:46.376083 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:46.376084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:46.376153 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:46.376885 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:46.376892 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:46.380814 (+ 3922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":66,"threads_started":1}
W20260806 00:53:46.381197 16008 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:46.372916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:59835 (local address 127.3.98.190:41101)
0806 00:53:46.372974 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:46.372977 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:46.373087 (+ 110us) server_negotiation.cc:407] Connection header received
0806 00:53:46.373151 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:46.373152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:46.373173 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:46.373237 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:46.373721 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:46.374421 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:46.375562 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:46.375985 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:46.376078 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:46.380979 (+ 4901us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:59835: BlockingRecv error: recv got EOF from 127.3.98.131:59835 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 06 00:53:47 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:47 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:47.101754 16012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:47.097077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:34871)
0806 00:53:47.097224 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:47.097239 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:47.097296 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:47.097503 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:47.097504 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:47.097682 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:47.097736 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:47.097738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:47.098385 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:47.098386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:47.098958 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:47.098960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:47.099298 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:47.099299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:47.099346 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:47.099847 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:47.099851 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:47.101695 (+ 1844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
W20260806 00:53:47.101914 16013 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:47.097145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:34871 (local address 127.3.98.190:41101)
0806 00:53:47.097277 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:47.097279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:47.097289 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:47.097353 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:47.097354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:47.097364 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:47.097428 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:47.097809 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:47.098314 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:47.099038 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:47.099232 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:47.099281 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:47.101816 (+ 2535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:34871: BlockingRecv error: recv got EOF from 127.3.98.129:34871 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
Aug 06 00:53:47 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:47 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:47.254266 16014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:47.249214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:45591)
0806 00:53:47.249365 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:47.249377 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:47.249427 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:47.249557 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:47.249558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:47.249745 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:47.249799 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:47.249801 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:47.250593 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:47.250594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:47.251113 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:47.251114 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:47.251540 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:47.251541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:47.251595 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:47.252135 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:47.252140 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:47.254207 (+ 2067us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":85,"threads_started":1}
W20260806 00:53:47.254455 16013 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:47.249316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:45591 (local address 127.3.98.190:41101)
0806 00:53:47.249419 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:47.249421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:47.249433 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:53:47.249470 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:47.249470 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:47.249483 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:47.249543 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:47.249879 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:47.250501 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:47.251200 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:47.251465 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:47.251529 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:47.254375 (+ 2846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:45591: BlockingRecv error: recv got EOF from 127.3.98.130:45591 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 06 00:53:47 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:47 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:47.385885 16015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:47.381476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:58003)
0806 00:53:47.381628 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:47.381638 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:47.381697 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:47.381832 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:47.381833 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:47.382008 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:47.382062 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:47.382063 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:47.382710 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:47.382711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:47.383221 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:47.383223 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:47.383546 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:47.383547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:47.383595 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:47.384072 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:47.384076 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:47.385817 (+ 1741us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
W20260806 00:53:47.385998 16013 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:47.381548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:58003 (local address 127.3.98.190:41101)
0806 00:53:47.381618 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:47.381620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:47.381695 (+ 75us) server_negotiation.cc:407] Connection header received
0806 00:53:47.381754 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:47.381755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:47.381767 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:47.381808 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:47.382125 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:47.382639 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:47.383292 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:47.383479 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:47.383528 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:47.385909 (+ 2381us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:58003: BlockingRecv error: recv got EOF from 127.3.98.131:58003 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 06 00:53:48 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:48 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:48.107273 16016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:48.102259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:57671)
0806 00:53:48.102443 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:48.102467 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:48.102528 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:48.102690 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:48.102691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:48.102873 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:48.102929 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:48.102931 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:48.103583 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:48.103584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:48.104111 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:48.104112 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:48.104659 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:48.104661 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:48.104731 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:48.105252 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:48.105257 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:48.107176 (+ 1919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":112,"threads_started":1}
W20260806 00:53:48.107354 16017 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:48.102364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:57671 (local address 127.3.98.190:41101)
0806 00:53:48.102499 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:48.102501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:48.102513 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:53:48.102593 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:48.102594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:48.102607 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:48.102667 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:48.102996 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:48.103513 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:48.104174 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:48.104525 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:48.104643 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:48.107276 (+ 2633us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:57671: BlockingRecv error: recv got EOF from 127.3.98.129:57671 (error 108)
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":73,"threads_started":1}
Aug 06 00:53:48 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:48 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:48.259747 16018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:48.254741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:37773)
0806 00:53:48.254947 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:48.254967 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:48.255014 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:48.255162 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:48.255163 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:48.255336 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:48.255389 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:48.255390 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:48.256100 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:48.256101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:48.256645 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:48.256647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:48.257108 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:48.257110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:48.257177 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:48.257748 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:48.257754 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:48.259650 (+ 1896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":112,"threads_started":1}
W20260806 00:53:48.259799 16017 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:48.254892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:37773 (local address 127.3.98.190:41101)
0806 00:53:48.255000 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:48.255002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:48.255015 (+ 13us) server_negotiation.cc:407] Connection header received
0806 00:53:48.255065 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:48.255066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:48.255080 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:48.255145 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:48.255485 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:48.256023 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:48.256754 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:48.257013 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:48.257101 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:48.259733 (+ 2632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:37773: BlockingRecv error: recv got EOF from 127.3.98.130:37773 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 06 00:53:48 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:48 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:48.391525 16020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:48.386545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:38953)
0806 00:53:48.386700 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:48.386711 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:48.386768 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:48.386992 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:48.386993 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:48.387168 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:48.387220 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:48.387222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:48.388032 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:48.388033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:48.388730 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:48.388733 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:48.389136 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:48.389138 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:48.389198 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:48.389646 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:48.389651 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:48.391465 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
W20260806 00:53:48.391681 16017 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:48.386632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:38953 (local address 127.3.98.190:41101)
0806 00:53:48.386720 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:48.386722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:48.386758 (+ 36us) server_negotiation.cc:407] Connection header received
0806 00:53:48.386887 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:48.386887 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:48.386904 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:48.386973 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:48.387332 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:48.387933 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:48.388831 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:48.389036 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:48.389130 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:48.391597 (+ 2467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:38953: BlockingRecv error: recv got EOF from 127.3.98.131:38953 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 06 00:53:49 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:49 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:49.112926 16022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:49.107810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:40253)
0806 00:53:49.108004 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:49.108015 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:49.108071 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:49.108237 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:49.108238 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:49.108414 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:49.108473 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:49.108504 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:49.109192 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:49.109192 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:49.109741 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:49.109743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:49.110205 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:49.110206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:49.110270 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:49.110790 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:49.110796 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:49.112812 (+ 2016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":115,"threads_started":1}
W20260806 00:53:49.113085 16023 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:49.107927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:40253 (local address 127.3.98.190:41101)
0806 00:53:49.108085 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:49.108087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:49.108114 (+ 27us) server_negotiation.cc:407] Connection header received
0806 00:53:49.108146 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:49.108146 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:49.108157 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:49.108210 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:49.108594 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:49.109120 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:49.109831 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:49.110080 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:49.110137 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:49.112946 (+ 2809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:40253: BlockingRecv error: recv got EOF from 127.3.98.129:40253 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":107,"threads_started":1}
Aug 06 00:53:49 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:49 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:49.265362 16026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:49.260251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:53785)
0806 00:53:49.260447 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:49.260508 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:49.260600 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:49.260760 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:49.260761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:49.260964 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:49.261017 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:49.261019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:49.261703 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:49.261704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:49.262240 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:49.262241 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:49.262660 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:49.262662 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:49.262717 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:49.263283 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:49.263288 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:49.265262 (+ 1974us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":105,"threads_started":1}
W20260806 00:53:49.265424 16023 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:49.260349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:53785 (local address 127.3.98.190:41101)
0806 00:53:49.260431 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:49.260434 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:49.260580 (+ 146us) server_negotiation.cc:407] Connection header received
0806 00:53:49.260661 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:49.260662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:49.260677 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:49.260752 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:49.261108 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:49.261612 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:49.262337 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:49.262545 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:49.262670 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:49.265350 (+ 2680us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:53785: BlockingRecv error: recv got EOF from 127.3.98.130:53785 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 06 00:53:49 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:49 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:49.397236 16027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:49.392131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:49219)
0806 00:53:49.392319 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:49.392331 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:49.392394 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:49.392554 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:49.392555 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:49.392748 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:49.392803 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:49.392805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:49.393550 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:49.393551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:49.394137 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:49.394140 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:49.394560 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:49.394561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:49.394601 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:49.395200 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:49.395205 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:49.397170 (+ 1965us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":104,"threads_started":1}
W20260806 00:53:49.397428 16023 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:49.392198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:49219 (local address 127.3.98.190:41101)
0806 00:53:49.392326 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:49.392328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:49.392380 (+ 52us) server_negotiation.cc:407] Connection header received
0806 00:53:49.392441 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:49.392442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:49.392457 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:49.392533 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:49.392882 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:49.393469 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:49.394259 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:49.394477 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:49.394552 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:49.397341 (+ 2789us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:49219: BlockingRecv error: recv got EOF from 127.3.98.131:49219 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 06 00:53:50 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:50 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:50.118742 16028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:50.113613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:53755)
0806 00:53:50.113796 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:50.113808 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:50.113876 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:50.114083 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:50.114085 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:50.114259 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:50.114315 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:50.114317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:50.115238 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:50.115239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:50.115855 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:50.115858 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:50.116227 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:50.116228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:50.116275 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:50.116784 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:50.116789 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:50.118681 (+ 1892us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":105,"threads_started":1}
W20260806 00:53:50.118891 16029 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:50.113709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:53755 (local address 127.3.98.190:41101)
0806 00:53:50.113820 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:50.113822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:50.113860 (+ 38us) server_negotiation.cc:407] Connection header received
0806 00:53:50.113943 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:50.113943 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:50.113986 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:50.114050 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:50.114416 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:50.115144 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:50.115931 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:50.116144 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:50.116206 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:50.118794 (+ 2588us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:53755: BlockingRecv error: recv got EOF from 127.3.98.129:53755 (error 108)
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":58,"threads_started":1}
Aug 06 00:53:50 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:50 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:50.275740 16030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:50.266017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:43987)
0806 00:53:50.266221 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:50.266233 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:50.266317 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:50.266494 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:50.266496 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:50.266687 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:50.266789 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:50.266792 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:50.267641 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:50.267643 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:50.268236 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:50.268238 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:50.268732 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:50.268733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:50.268800 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:50.273458 (+ 4658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:50.273465 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:50.275655 (+ 2190us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":139,"threads_started":1}
W20260806 00:53:50.275846 16029 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:50.266164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:43987 (local address 127.3.98.190:41101)
0806 00:53:50.266241 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:50.266244 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:50.266315 (+ 71us) server_negotiation.cc:407] Connection header received
0806 00:53:50.266387 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:50.266388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:50.266400 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:50.266462 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:50.266989 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:50.267528 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:50.268352 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:50.268627 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:50.268730 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:50.275778 (+ 7048us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:43987: BlockingRecv error: recv got EOF from 127.3.98.130:43987 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 06 00:53:50 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:50 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:50.403365 16031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:50.397913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:48691)
0806 00:53:50.398181 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:50.398196 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:50.398291 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:50.398509 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:50.398511 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:50.398722 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:50.398777 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:50.398778 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:50.399559 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:50.399560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:50.400156 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:50.400159 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:50.400660 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:50.400661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:50.400735 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:50.401213 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:50.401218 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:50.403249 (+ 2031us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":124,"threads_started":1}
W20260806 00:53:50.403412 16029 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:50.398066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:48691 (local address 127.3.98.190:41101)
0806 00:53:50.398132 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:50.398134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:50.398355 (+ 221us) server_negotiation.cc:407] Connection header received
0806 00:53:50.398402 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:50.398404 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:50.398433 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:50.398499 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:50.398889 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:50.399448 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:50.400283 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:50.400556 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:50.400656 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:50.403342 (+ 2686us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:48691: BlockingRecv error: recv got EOF from 127.3.98.131:48691 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 06 00:53:51 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:51 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:51.124339 16032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:51.119334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:52997)
0806 00:53:51.119571 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:51.119582 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:51.119640 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:51.119794 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:51.119795 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:51.120059 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:51.120120 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:51.120123 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:51.120841 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:51.120842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:51.121416 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:51.121419 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:51.121782 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:51.121783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:51.121831 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:51.122328 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:51.122335 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:51.124268 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":112,"threads_started":1}
W20260806 00:53:51.124425 16033 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:51.119485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:52997 (local address 127.3.98.190:41101)
0806 00:53:51.119635 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:51.119637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:51.119647 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:51.119687 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:51.119688 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:51.119698 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:51.119759 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:51.120197 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:51.120752 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:51.121496 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:51.121704 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:51.121756 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:51.124368 (+ 2612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:52997: BlockingRecv error: recv got EOF from 127.3.98.129:52997 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":67,"threads_started":1}
Aug 06 00:53:51 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:51 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:51.281725 16034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:51.276309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:56999)
0806 00:53:51.276471 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:51.276502 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:51.276590 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:51.276866 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:51.276869 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:51.277105 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:51.277159 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:51.277161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:51.278009 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:51.278011 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:51.278562 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:51.278563 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:51.278920 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:51.278922 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:51.278973 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:51.279678 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:51.279683 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:51.281663 (+ 1980us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":110,"threads_started":1}
W20260806 00:53:51.281873 16033 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:51.276396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:56999 (local address 127.3.98.190:41101)
0806 00:53:51.276454 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:51.276456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:51.276558 (+ 102us) server_negotiation.cc:407] Connection header received
0806 00:53:51.276645 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:51.276646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:51.276659 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:51.276719 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:51.277244 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:51.277913 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:51.278651 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:51.278843 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:51.278896 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:51.281787 (+ 2891us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:56999: BlockingRecv error: recv got EOF from 127.3.98.130:56999 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 06 00:53:51 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:51 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:51.411207 16035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:51.403946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:34891)
0806 00:53:51.404084 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:51.404095 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:51.404174 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:51.404369 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:51.404371 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:51.404648 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:51.404734 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:51.404736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:51.407051 (+ 2315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:51.407053 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:51.407612 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:51.407614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:51.408148 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:51.408149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:51.408200 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:51.408802 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:51.408811 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:51.411118 (+ 2307us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":59,"threads_started":1}
W20260806 00:53:51.411369 16033 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:51.404021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:34891 (local address 127.3.98.190:41101)
0806 00:53:51.404093 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:51.404095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:51.404154 (+ 59us) server_negotiation.cc:407] Connection header received
0806 00:53:51.404235 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:51.404236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:51.404252 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:51.404333 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:51.404849 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:51.405628 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:51.407716 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:51.408049 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:51.408138 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:51.411309 (+ 3171us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:34891: BlockingRecv error: recv got EOF from 127.3.98.131:34891 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 06 00:53:52 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:52 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:52.130432 16037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:52.125009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:52319)
0806 00:53:52.125189 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:52.125207 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:52.125261 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:52.125467 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:52.125468 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:52.125659 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:52.125713 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:52.125714 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:52.126563 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:52.126564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:52.127252 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:52.127255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:52.127731 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:52.127732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:52.127779 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:52.128316 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:52.128322 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:52.130370 (+ 2048us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":115,"threads_started":1}
W20260806 00:53:52.130681 16039 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:52.125113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:52319 (local address 127.3.98.190:41101)
0806 00:53:52.125285 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:52.125286 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:52.125297 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:53:52.125326 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:52.125326 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:52.125338 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:52.125444 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:52.125825 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:52.126417 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:52.127374 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:52.127652 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:52.127720 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:52.130580 (+ 2860us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:52319: BlockingRecv error: recv got EOF from 127.3.98.129:52319 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":108,"threads_started":1}
Aug 06 00:53:52 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:52 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:52.287115 16040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:52.282214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:57931)
0806 00:53:52.282374 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:52.282384 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:52.282444 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:52.282594 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:52.282595 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:52.282788 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:52.282841 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:52.282843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:52.283615 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:52.283616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:52.284149 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:52.284150 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:52.284562 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:52.284563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:52.284625 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:52.285092 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:52.285096 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:52.287036 (+ 1940us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
W20260806 00:53:52.287261 16039 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:52.282292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:57931 (local address 127.3.98.190:41101)
0806 00:53:52.282380 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:52.282382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:52.282447 (+ 65us) server_negotiation.cc:407] Connection header received
0806 00:53:52.282508 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:52.282509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:52.282520 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:52.282563 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:52.283005 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:52.283517 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:52.284237 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:52.284432 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:52.284568 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:52.287172 (+ 2604us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:57931: BlockingRecv error: recv got EOF from 127.3.98.130:57931 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 06 00:53:52 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:52 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:52.416966 16041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:52.411764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:50927)
0806 00:53:52.411936 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:52.411948 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:52.412026 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:52.412194 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:52.412195 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:52.412377 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:52.412430 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:52.412431 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:52.413429 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:52.413430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:52.414094 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:52.414096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:52.414431 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:52.414432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:52.414504 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:52.414968 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:52.414972 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:52.416899 (+ 1927us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":109,"threads_started":1}
W20260806 00:53:52.417110 16039 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:52.411882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:50927 (local address 127.3.98.190:41101)
0806 00:53:52.411939 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:52.411941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:52.412004 (+ 63us) server_negotiation.cc:407] Connection header received
0806 00:53:52.412105 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:52.412106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:52.412120 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:52.412166 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:52.412600 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:52.413320 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:52.414179 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:52.414364 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:52.414417 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:52.416993 (+ 2576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:50927: BlockingRecv error: recv got EOF from 127.3.98.131:50927 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 06 00:53:53 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:53 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:53.136636 16043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:53.131165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:59189)
0806 00:53:53.131337 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:53.131349 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:53.131406 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:53.131765 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:53.131767 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:53.131993 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:53.132046 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:53.132048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:53.132799 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:53.132800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:53.133352 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:53.133355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:53.133711 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:53.133712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:53.133820 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:53.134354 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:53.134359 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:53.136537 (+ 2178us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":73,"threads_started":1}
W20260806 00:53:53.136775 16044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:53.131343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:59189 (local address 127.3.98.190:41101)
0806 00:53:53.131543 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:53.131545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:53.131555 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:53.131594 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:53.131595 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:53.131609 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:53.131689 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:53.132136 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:53.132722 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:53.133436 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:53.133634 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:53.133692 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:53.136661 (+ 2969us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:59189: BlockingRecv error: recv got EOF from 127.3.98.129:59189 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":106,"threads_started":1}
Aug 06 00:53:53 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:53 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:53.292774 16045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:53.287657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:52539)
0806 00:53:53.287822 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:53.287834 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:53.287894 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:53.288090 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:53.288091 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:53.288281 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:53.288332 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:53.288334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:53.289137 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:53.289138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:53.289704 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:53.289706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:53.290097 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:53.290098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:53.290142 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:53.290628 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:53.290633 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:53.292670 (+ 2037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":105,"threads_started":1}
W20260806 00:53:53.292833 16044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:53.287783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:52539 (local address 127.3.98.190:41101)
0806 00:53:53.287876 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:53.287878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:53.287887 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:53:53.287976 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:53.287977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:53.287990 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:53.288047 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:53.288418 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:53.289039 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:53.289794 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:53.290015 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:53.290074 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:53.292765 (+ 2691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:52539: BlockingRecv error: recv got EOF from 127.3.98.130:52539 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 06 00:53:53 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:53 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:53.422967 16046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:53.417599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:60215)
0806 00:53:53.417800 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:53.417812 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:53.417905 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:53.418056 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:53.418057 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:53.418243 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:53.418294 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:53.418296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:53.419065 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:53.419075 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:53.419702 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:53.419704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:53.420100 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:53.420101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:53.420165 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:53.420790 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:53.420795 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:53.422897 (+ 2102us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":123,"threads_started":1}
W20260806 00:53:53.423091 16044 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:53.417706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:60215 (local address 127.3.98.190:41101)
0806 00:53:53.417784 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:53.417786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:53.417906 (+ 120us) server_negotiation.cc:407] Connection header received
0806 00:53:53.417965 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:53.417966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:53.417980 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:53.418030 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:53.418358 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:53.418963 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:53.419802 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:53.420004 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:53.420094 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:53.422992 (+ 2898us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:60215: BlockingRecv error: recv got EOF from 127.3.98.131:60215 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 06 00:53:54 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:54 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:54.141911 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:54.137152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:39541)
0806 00:53:54.137304 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:54.137316 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:54.137380 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:54.137525 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:54.137525 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:54.137717 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:54.137770 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:54.137772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:54.138429 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:54.138430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:54.139007 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:54.139009 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:54.139372 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:54.139373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:54.139416 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:54.139897 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:54.139901 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:54.141840 (+ 1939us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":96,"threads_started":1}
W20260806 00:53:54.142056 16048 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:54.137211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:39541 (local address 127.3.98.190:41101)
0806 00:53:54.137350 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:54.137352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:54.137363 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:53:54.137441 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:54.137442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:54.137459 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:54.137522 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:54.137835 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:54.138349 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:54.139094 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:54.139296 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:54.139353 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:54.141959 (+ 2606us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:39541: BlockingRecv error: recv got EOF from 127.3.98.129:39541 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
Aug 06 00:53:54 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:54 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:54.298570 16049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:54.293416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:45669)
0806 00:53:54.293606 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:54.293626 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:54.293696 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:54.293907 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:54.293909 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:54.294104 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:54.294159 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:54.294161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:54.294944 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:54.294946 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:54.295529 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:54.295531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:54.295916 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:54.295918 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:54.295980 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:54.296569 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:54.296575 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:54.298468 (+ 1893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":130,"threads_started":1}
W20260806 00:53:54.298633 16048 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:54.293499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:45669 (local address 127.3.98.190:41101)
0806 00:53:54.293550 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:54.293553 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:54.293700 (+ 147us) server_negotiation.cc:407] Connection header received
0806 00:53:54.293751 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:54.293751 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:54.293763 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:54.293819 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:54.294236 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:54.294814 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:54.295627 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:54.295815 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:54.295869 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:54.298582 (+ 2713us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:45669: BlockingRecv error: recv got EOF from 127.3.98.130:45669 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 06 00:53:54 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:54 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:54.428141 16052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:54.423449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:45573)
0806 00:53:54.423591 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:54.423603 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:54.423673 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:54.423848 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:54.423849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:54.424032 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:54.424098 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:54.424100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:54.424766 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:54.424767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:54.425311 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:54.425312 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:54.425708 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:54.425708 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:54.425750 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:54.426239 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:54.426244 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:54.428082 (+ 1838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
W20260806 00:53:54.428377 16048 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:54.423541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:45573 (local address 127.3.98.190:41101)
0806 00:53:54.423614 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:54.423616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:54.423656 (+ 40us) server_negotiation.cc:407] Connection header received
0806 00:53:54.423748 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:54.423749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:54.423762 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:54.423824 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:54.424172 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:54.424698 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:54.425405 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:54.425633 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:54.425691 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:54.428195 (+ 2504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:45573: BlockingRecv error: recv got EOF from 127.3.98.131:45573 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 06 00:53:55 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:55 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:55.147320 16053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:55.142473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:44219)
0806 00:53:55.142654 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:55.142665 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:55.142713 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:55.142875 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:55.142876 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:55.143060 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:55.143114 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:55.143116 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:55.143768 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:55.143769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:55.144294 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:55.144295 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:55.144744 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:55.144745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:55.144790 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:55.145273 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:55.145278 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:55.147248 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":105,"threads_started":1}
W20260806 00:53:55.147442 16054 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:55.142575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:44219 (local address 127.3.98.190:41101)
0806 00:53:55.142683 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:55.142689 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:55.142714 (+ 25us) server_negotiation.cc:407] Connection header received
0806 00:53:55.142786 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:55.142786 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:55.142799 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:55.142851 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:55.143186 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:55.143696 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:55.144382 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:55.144673 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:55.144733 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:55.147359 (+ 2626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:44219: BlockingRecv error: recv got EOF from 127.3.98.129:44219 (error 108)
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":52,"threads_started":1}
Aug 06 00:53:55 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:55 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:55.310281 16055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:55.299219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:45005)
0806 00:53:55.299499 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:55.299515 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:55.299603 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:55.299784 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:55.299786 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:55.300008 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:55.300061 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:55.300063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:55.300732 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:55.300733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:55.301276 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:55.301278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:55.301603 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:55.301604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:55.301646 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:55.308170 (+ 6524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:55.308176 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:55.310205 (+ 2029us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":80,"threads_started":1}
W20260806 00:53:55.310474 16054 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:55.299464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:45005 (local address 127.3.98.190:41101)
0806 00:53:55.299549 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:55.299550 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:55.299592 (+ 42us) server_negotiation.cc:407] Connection header received
0806 00:53:55.299657 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:55.299658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:55.299669 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:55.299720 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:55.300140 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:55.300666 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:55.301352 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:55.301536 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:55.301600 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:55.310392 (+ 8792us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:45005: BlockingRecv error: recv got EOF from 127.3.98.130:45005 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 06 00:53:55 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:55 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:55.433915 16057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:55.428688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:35049)
0806 00:53:55.428883 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:55.428896 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:55.429016 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:55.429180 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:55.429181 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:55.429377 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:55.429425 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:55.429427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:55.430164 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:55.430166 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:55.430753 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:55.430755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:55.431184 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:55.431185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:55.431246 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:55.431778 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:55.431784 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:55.433805 (+ 2021us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":92,"threads_started":1}
W20260806 00:53:55.433948 16054 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:55.428788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:35049 (local address 127.3.98.190:41101)
0806 00:53:55.428868 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:55.428871 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:55.428996 (+ 125us) server_negotiation.cc:407] Connection header received
0806 00:53:55.429076 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:55.429076 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:55.429092 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:55.429173 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:55.429551 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:55.430069 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:55.430853 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:55.431064 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:55.431184 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:55.433882 (+ 2698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:35049: BlockingRecv error: recv got EOF from 127.3.98.131:35049 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 06 00:53:56 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:56 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:56.152976 16058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:56.147851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:46949)
0806 00:53:56.148041 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:56.148053 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:56.148120 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:56.148290 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:56.148291 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:56.148568 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:56.148633 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:56.148636 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:56.149301 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:56.149302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:56.149862 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:56.149863 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:56.150231 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:56.150232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:56.150278 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:56.150779 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:56.150786 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:56.152906 (+ 2120us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":114,"threads_started":1}
W20260806 00:53:56.153107 16059 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:56.148008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:46949 (local address 127.3.98.190:41101)
0806 00:53:56.148147 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:56.148149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:56.148158 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:53:56.148191 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:56.148192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:56.148203 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:56.148263 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:56.148714 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:56.149213 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:56.149949 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:56.150155 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:56.150209 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:56.153002 (+ 2793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:46949: BlockingRecv error: recv got EOF from 127.3.98.129:46949 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
Aug 06 00:53:56 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:56 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:56.315861 16060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:56.310765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:34767)
0806 00:53:56.310961 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:56.310973 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:56.311040 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:56.311193 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:56.311194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:56.311374 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:56.311425 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:56.311427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:56.312266 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:56.312267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:56.312857 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:56.312859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:56.313254 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:56.313254 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:56.313296 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:56.313863 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:56.313869 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:56.315803 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":135,"threads_started":1}
W20260806 00:53:56.316064 16059 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:56.310904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:34767 (local address 127.3.98.190:41101)
0806 00:53:56.310963 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:56.310966 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:56.311029 (+ 63us) server_negotiation.cc:407] Connection header received
0806 00:53:56.311101 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:56.311102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:56.311115 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:56.311162 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:56.311540 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:56.312163 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:56.312958 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:56.313172 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:56.313237 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:56.315930 (+ 2693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:34767: BlockingRecv error: recv got EOF from 127.3.98.130:34767 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 06 00:53:56 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:56 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:56.440413 16062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:56.434531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:39929)
0806 00:53:56.434679 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:56.434692 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:56.434807 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:56.435021 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:56.435023 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:56.435249 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:56.435312 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:56.435314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:56.436383 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:56.436385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:56.437269 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:56.437272 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:56.437670 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:56.437672 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:56.437732 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:56.438295 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:56.438301 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:56.440310 (+ 2009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
W20260806 00:53:56.440469 16059 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:56.434565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:39929 (local address 127.3.98.190:41101)
0806 00:53:56.434614 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:56.434617 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:56.434872 (+ 255us) server_negotiation.cc:407] Connection header received
0806 00:53:56.434896 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:56.434897 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:56.434911 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:56.434961 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:56.435393 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:56.436300 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:56.437346 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:56.437567 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:56.437667 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:56.440397 (+ 2730us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:39929: BlockingRecv error: recv got EOF from 127.3.98.131:39929 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 06 00:53:57 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:57 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:57.158284 16063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:57.153570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:51823)
0806 00:53:57.153698 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:57.153712 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:57.153771 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:57.153890 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:57.153891 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:57.154080 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:57.154131 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:57.154134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:57.154796 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:57.154797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:57.155336 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:57.155338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:57.155691 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:57.155692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:57.155736 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:57.156237 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:57.156242 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:57.158224 (+ 1982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":73,"threads_started":1}
W20260806 00:53:57.158423 16065 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:57.153630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:51823 (local address 127.3.98.190:41101)
0806 00:53:57.153776 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:57.153777 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:57.153787 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:57.153812 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:57.153812 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:57.153822 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:57.153886 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:57.154203 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:57.154716 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:57.155416 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:57.155618 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:57.155671 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:57.158333 (+ 2662us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:51823: BlockingRecv error: recv got EOF from 127.3.98.129:51823 (error 108)
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
Aug 06 00:53:57 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:57 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:57.321408 16068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:57.316483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:39247)
0806 00:53:57.316638 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:57.316650 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:57.316719 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:57.316841 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:57.316841 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:57.317021 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:57.317091 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:57.317093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:57.317755 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:57.317756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:57.318296 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:57.318298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:57.318681 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:57.318682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:57.318728 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:57.319266 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:57.319271 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:57.321345 (+ 2074us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":100,"threads_started":1}
W20260806 00:53:57.321507 16065 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:57.316598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:39247 (local address 127.3.98.190:41101)
0806 00:53:57.316668 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:57.316674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:57.316702 (+ 28us) server_negotiation.cc:407] Connection header received
0806 00:53:57.316765 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:57.316766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:57.316776 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:57.316826 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:57.317155 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:57.317674 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:57.318369 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:57.318604 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:57.318661 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:57.321456 (+ 2795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:39247: BlockingRecv error: recv got EOF from 127.3.98.130:39247 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 06 00:53:57 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:57 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.131@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:57.446501 16069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:57.441226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.131:38207)
0806 00:53:57.441378 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:57.441390 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:57.441478 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:57.441677 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:57.441678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:57.441869 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:57.441918 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:57.441920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:57.442644 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:57.442645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:57.443189 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:57.443191 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:57.443567 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:57.443568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:57.443628 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:57.444255 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:57.444262 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:57.446404 (+ 2142us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
W20260806 00:53:57.446578 16065 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:57.441368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:38207 (local address 127.3.98.190:41101)
0806 00:53:57.441449 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:57.441451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:57.441461 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:57.441577 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:57.441578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:57.441597 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:57.441663 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:57.442006 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:57.442534 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:57.443282 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:57.443481 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:57.443576 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:57.446518 (+ 2942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.131:38207: BlockingRecv error: recv got EOF from 127.3.98.131:38207 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 06 00:53:58 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:58 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.129@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:58.164465 16070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:58.158906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.129:54789)
0806 00:53:58.159109 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:58.159123 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:58.159209 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:58.159364 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:58.159365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:58.159584 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:58.159639 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:58.159641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.160299 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.160300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:58.161285 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:58.161290 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.161655 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.161656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:58.161706 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:58.162370 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:58.162377 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:58.164391 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":100,"threads_started":1}
W20260806 00:53:58.164686 16071 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:58.159053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:54789 (local address 127.3.98.190:41101)
0806 00:53:58.159210 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:58.159212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:58.159222 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:53:58.159265 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:58.159265 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:58.159277 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:58.159335 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:58.159715 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.160218 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.161372 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.161582 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.161637 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:58.164608 (+ 2971us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.129:54789: BlockingRecv error: recv got EOF from 127.3.98.129:54789 (error 108)
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":79,"threads_started":1}
Aug 06 00:53:58 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 00:53:58 dist-test-slave-44d2 krb5kdc[14625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.3.98.130@KRBTEST.COM for oryx/127.3.98.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 00:53:58.327469 16074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:58.322128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41101 (local address 127.3.98.130:32961)
0806 00:53:58.322292 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:58.322305 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:58.322371 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:58.322523 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:58.322524 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:58.322705 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:58.322760 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:58.322762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.323453 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.323454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:58.323983 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:58.323985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.324349 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.324350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:58.324394 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:58.325046 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:53:58.325052 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:58.327320 (+ 2268us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.98.190:41101: Server oryx/127.3.98.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":110,"threads_started":1}
W20260806 00:53:58.327518 16071 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:58.322245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:32961 (local address 127.3.98.190:41101)
0806 00:53:58.322300 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:58.322302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:58.322359 (+ 57us) server_negotiation.cc:407] Connection header received
0806 00:53:58.322440 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:58.322441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:58.322455 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:58.322500 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:58.322834 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.323371 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.324074 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.324274 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.324332 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:58.327445 (+ 3113us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.98.130:32961: BlockingRecv error: recv got EOF from 127.3.98.130:32961 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 00:53:58.357195 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 15416
I20260806 00:53:58.367362 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 15625
I20260806 00:53:58.378075 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 15804
I20260806 00:53:58.388594 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 15310
2026-08-06T00:53:58Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18239 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T00:53:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:58Z Disabled control of system clock
I20260806 00:53:58.422058 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:34927
--webserver_interface=127.3.98.190
--webserver_port=0
--builtin_ntp_servers=127.3.98.148:41183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:34927
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 00:53:58.515166 16079 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:58.515375 16079 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:58.515395 16079 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:58.516563 16079 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:58.516618 16079 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:58.516631 16079 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:58.516645 16079 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:58.516657 16079 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:58.517971 16079 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:34927
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:34927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16079
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:58.518172 16079 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:58.518426 16079 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:58.523602 16089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:58.523602 16091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:58.523672 16088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:58.523834 16079 server_base.cc:1034] running on GCE node
I20260806 00:53:58.524101 16079 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:58.524454 16079 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:58.525655 16079 hybrid_clock.cc:648] HybridClock initialized: now 1785977638525639 us; error 37 us; skew 500 ppm
I20260806 00:53:58.527068 16079 webserver.cc:460] Webserver started at http://127.3.98.190:33601/ using document root <none> and password file <none>
I20260806 00:53:58.527384 16079 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:58.527470 16079 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:58.527649 16079 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:58.529000 16079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "ad733891ef4940429c396fa3765fd70f"
format_stamp: "Formatted at 2026-08-06 00:53:58 on dist-test-slave-44d2"
server_key: "3fd583d5b571401aaf58297a97e75a00"
server_key_iv: "d52086df31f869e98ffa5b4dc5060324"
server_key_version: "encryptionkey@0"
I20260806 00:53:58.529459 16079 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "ad733891ef4940429c396fa3765fd70f"
format_stamp: "Formatted at 2026-08-06 00:53:58 on dist-test-slave-44d2"
server_key: "3fd583d5b571401aaf58297a97e75a00"
server_key_iv: "d52086df31f869e98ffa5b4dc5060324"
server_key_version: "encryptionkey@0"
I20260806 00:53:58.531069 16079 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:53:58.532148 16098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:58.532377 16079 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:58.532528 16079 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "ad733891ef4940429c396fa3765fd70f"
format_stamp: "Formatted at 2026-08-06 00:53:58 on dist-test-slave-44d2"
server_key: "3fd583d5b571401aaf58297a97e75a00"
server_key_iv: "d52086df31f869e98ffa5b4dc5060324"
server_key_version: "encryptionkey@0"
I20260806 00:53:58.532634 16079 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:58.542956 16079 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:58.543291 16079 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:58.543463 16079 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:58.548097 16079 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:34927
I20260806 00:53:58.548130 16165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:34927 every 8 connection(s)
I20260806 00:53:58.548581 16079 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:58.549314 16166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:58.551841 16166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f: Bootstrap starting.
I20260806 00:53:58.552403 16166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:58.552742 16166 log.cc:824] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:58.553412 16166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f: No bootstrap required, opened a new log
I20260806 00:53:58.554961 16166 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad733891ef4940429c396fa3765fd70f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34927 } }
I20260806 00:53:58.555106 16166 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:58.555130 16166 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad733891ef4940429c396fa3765fd70f, State: Initialized, Role: FOLLOWER
I20260806 00:53:58.555265 16166 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad733891ef4940429c396fa3765fd70f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34927 } }
I20260806 00:53:58.555351 16166 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:58.555374 16166 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:58.555403 16166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:58.555886 16166 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad733891ef4940429c396fa3765fd70f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34927 } }
I20260806 00:53:58.555974 16166 leader_election.cc:302] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad733891ef4940429c396fa3765fd70f; no voters:
I20260806 00:53:58.556104 16166 leader_election.cc:288] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:58.556181 16171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:58.556386 16171 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [term 1 LEADER]: Becoming Leader. State: Replica: ad733891ef4940429c396fa3765fd70f, State: Running, Role: LEADER
I20260806 00:53:58.556401 16166 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:58.556725 16171 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad733891ef4940429c396fa3765fd70f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34927 } }
I20260806 00:53:58.557165 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 16079
I20260806 00:53:58.557296 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:58.557554 3466 external_mini_cluster.cc:1428] Setting key 15ffa9ff9f5b6a3085720350bdcd702a
I20260806 00:53:58.558385 16174 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad733891ef4940429c396fa3765fd70f. Latest consensus state: current_term: 1 leader_uuid: "ad733891ef4940429c396fa3765fd70f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad733891ef4940429c396fa3765fd70f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34927 } } }
I20260806 00:53:58.558478 16173 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad733891ef4940429c396fa3765fd70f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad733891ef4940429c396fa3765fd70f" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34927 } } }
I20260806 00:53:58.558540 16173 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:58.558746 16192 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:58.558485 16174 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:58.559875 16192 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:58.561870 16192 catalog_manager.cc:1347] Generated new cluster ID: dd50101841644a49a193b24fbaac6d47
I20260806 00:53:58.561936 16192 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:53:58.564083 16191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:58.558231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44452 (local address 127.3.98.190:34927)
0806 00:53:58.558511 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:58.558522 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:58.558559 (+ 37us) server_negotiation.cc:407] Connection header received
0806 00:53:58.558694 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:58.558702 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:58.558892 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:58.559061 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:58.559425 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.560461 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.561636 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.562274 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.562734 (+ 460us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:58.563243 (+ 509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:58.563247 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:58.563247 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:58.563457 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:58.563497 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:58.563512 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:58.563742 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:58.563776 (+ 34us) server_negotiation.cc:299] Negotiation successful
0806 00:53:58.563856 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":117,"threads_started":1}
I20260806 00:53:58.569262 16192 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:58.569998 16192 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:58.573438 16192 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad733891ef4940429c396fa3765fd70f: Generated new TSK 0
I20260806 00:53:58.573642 16192 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:53:58.575645 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:34927
--builtin_ntp_servers=127.3.98.148:41183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 00:53:58.678390 16199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:58.678611 16199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:58.678635 16199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:58.679811 16199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:58.679865 16199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:58.679893 16199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:58.681308 16199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:34927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:58.681576 16199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:58.681948 16199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:58.689538 16212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:58.689512 16215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:58.689505 16211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:58.689821 16199 server_base.cc:1034] running on GCE node
I20260806 00:53:58.690055 16199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:58.690389 16199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:58.691583 16199 hybrid_clock.cc:648] HybridClock initialized: now 1785977638691568 us; error 31 us; skew 500 ppm
I20260806 00:53:58.693285 16199 webserver.cc:460] Webserver started at http://127.3.98.129:43321/ using document root <none> and password file <none>
I20260806 00:53:58.693614 16199 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:58.693687 16199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:58.693845 16199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:58.695536 16199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "294e3fc5ce2f40af88a156721cd919c6"
format_stamp: "Formatted at 2026-08-06 00:53:58 on dist-test-slave-44d2"
server_key: "ad62ea57f6a6d35dc2ab07d8c61c3c30"
server_key_iv: "1955a54d377d1b562e8ca457cb44e0d3"
server_key_version: "encryptionkey@0"
I20260806 00:53:58.696018 16199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "294e3fc5ce2f40af88a156721cd919c6"
format_stamp: "Formatted at 2026-08-06 00:53:58 on dist-test-slave-44d2"
server_key: "ad62ea57f6a6d35dc2ab07d8c61c3c30"
server_key_iv: "1955a54d377d1b562e8ca457cb44e0d3"
server_key_version: "encryptionkey@0"
I20260806 00:53:58.698141 16199 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260806 00:53:58.699131 16223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:58.699330 16199 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:58.699450 16199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "294e3fc5ce2f40af88a156721cd919c6"
format_stamp: "Formatted at 2026-08-06 00:53:58 on dist-test-slave-44d2"
server_key: "ad62ea57f6a6d35dc2ab07d8c61c3c30"
server_key_iv: "1955a54d377d1b562e8ca457cb44e0d3"
server_key_version: "encryptionkey@0"
I20260806 00:53:58.699536 16199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:58.714114 16199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:58.714557 16199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:58.714737 16199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:58.715006 16199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:58.715454 16199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:58.715512 16199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:58.715546 16199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:58.715579 16199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:58.723740 16199 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:33953
I20260806 00:53:58.723793 16383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:33953 every 8 connection(s)
I20260806 00:53:58.724299 16199 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:53:58.731160 16191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:58.725163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:58129 (local address 127.3.98.190:34927)
0806 00:53:58.725235 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:58.725238 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:58.725501 (+ 263us) server_negotiation.cc:407] Connection header received
0806 00:53:58.726046 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:58.726047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:58.726062 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:58.726149 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:58.726872 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.727866 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.729479 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.729818 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.729913 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:58.730865 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:58.730866 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:58.730867 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:58.730873 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:58.730892 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:58.730897 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:58.730959 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:58.731021 (+ 62us) server_negotiation.cc:299] Negotiation successful
0806 00:53:58.731057 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 00:53:58.731329 16387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:58.725125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:34927 (local address 127.3.98.129:58129)
0806 00:53:58.725365 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:58.725408 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:58.725941 (+ 533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:58.726223 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:58.726227 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:58.726236 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:58.726771 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:58.726776 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.728005 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.728006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:58.729379 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:58.729383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.729955 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.729956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:58.730091 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:58.730712 (+ 621us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:58.730712 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:58.730744 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:58.730770 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:58.730959 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:58.730963 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:58.730966 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:58.731024 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 00:53:58.731114 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":120,"threads_started":1}
I20260806 00:53:58.731971 16384 heartbeater.cc:347] Connected to a master server at 127.3.98.190:34927
I20260806 00:53:58.732134 16384 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:58.732399 16384 heartbeater.cc:511] Master 127.3.98.190:34927 requested a full tablet report, sending...
I20260806 00:53:58.733050 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 16199
I20260806 00:53:58.733101 16118 ts_manager.cc:194] Registered new tserver with Master: 294e3fc5ce2f40af88a156721cd919c6 (127.3.98.129:33953)
I20260806 00:53:58.733162 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:58.733387 3466 external_mini_cluster.cc:1428] Setting key 8748c07ddc8cf977e8812df2ec36161a
I20260806 00:53:58.734055 16118 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.98.129:58129
I20260806 00:53:58.734732 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:34927
--builtin_ntp_servers=127.3.98.148:41183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 00:53:58.825289 16388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:58.825552 16388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:58.825594 16388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:58.826795 16388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:58.826876 16388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:58.826923 16388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:58.828354 16388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:34927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:58.828675 16388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:58.829021 16388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:58.834645 16398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:58.834717 16393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:58.834658 16394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:58.835206 16388 server_base.cc:1034] running on GCE node
I20260806 00:53:58.835462 16388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:58.835723 16388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:58.836915 16388 hybrid_clock.cc:648] HybridClock initialized: now 1785977638836888 us; error 57 us; skew 500 ppm
I20260806 00:53:58.838446 16388 webserver.cc:460] Webserver started at http://127.3.98.130:41737/ using document root <none> and password file <none>
I20260806 00:53:58.838729 16388 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:58.838809 16388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:58.838968 16388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:58.840152 16388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "d7d98bb672af45afb3da655a9f4ff8a0"
format_stamp: "Formatted at 2026-08-06 00:53:58 on dist-test-slave-44d2"
server_key: "7d4758aec28bf375d0430335f6360352"
server_key_iv: "f298d196ada7b0f728816bb4b0c22a7c"
server_key_version: "encryptionkey@0"
I20260806 00:53:58.840642 16388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "d7d98bb672af45afb3da655a9f4ff8a0"
format_stamp: "Formatted at 2026-08-06 00:53:58 on dist-test-slave-44d2"
server_key: "7d4758aec28bf375d0430335f6360352"
server_key_iv: "f298d196ada7b0f728816bb4b0c22a7c"
server_key_version: "encryptionkey@0"
I20260806 00:53:58.842190 16388 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:58.843036 16407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:58.843238 16388 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:58.843339 16388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "d7d98bb672af45afb3da655a9f4ff8a0"
format_stamp: "Formatted at 2026-08-06 00:53:58 on dist-test-slave-44d2"
server_key: "7d4758aec28bf375d0430335f6360352"
server_key_iv: "f298d196ada7b0f728816bb4b0c22a7c"
server_key_version: "encryptionkey@0"
I20260806 00:53:58.843421 16388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:58.853065 16388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:58.853403 16388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:58.853551 16388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:58.853771 16388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:58.854125 16388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:58.854177 16388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:58.854220 16388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:58.854246 16388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:58.860271 16388 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:41585
I20260806 00:53:58.860344 16564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:41585 every 8 connection(s)
I20260806 00:53:58.860700 16388 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:58.861418 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 16388
I20260806 00:53:58.861512 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:58.861763 3466 external_mini_cluster.cc:1428] Setting key 576d7284e8a1d95ffa69291fdc1c2978
I20260806 00:53:58.862823 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:34927
--builtin_ntp_servers=127.3.98.148:41183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 00:53:58.866839 16191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:58.861805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:44975 (local address 127.3.98.190:34927)
0806 00:53:58.861982 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:58.861985 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:58.862000 (+ 15us) server_negotiation.cc:407] Connection header received
0806 00:53:58.862583 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:58.862584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:58.862597 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:58.862671 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:58.863442 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.864187 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.865276 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.865497 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.865583 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:58.866548 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:58.866549 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:58.866550 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:58.866556 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:58.866573 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:58.866577 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:58.866626 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:58.866722 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 00:53:58.866756 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260806 00:53:58.867093 16567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:58.861508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:34927 (local address 127.3.98.130:44975)
0806 00:53:58.861730 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:58.861765 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:58.862492 (+ 727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:58.862726 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:58.862729 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:58.862738 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:58.863342 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:58.863348 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.864293 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.864294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:58.865165 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:58.865168 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.865599 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.865600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:58.865732 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:58.866393 (+ 661us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:58.866393 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:58.866423 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:58.866446 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:58.866626 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:58.866632 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:58.866635 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:58.866722 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 00:53:58.866830 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":121,"threads_started":1}
I20260806 00:53:58.867612 16565 heartbeater.cc:347] Connected to a master server at 127.3.98.190:34927
I20260806 00:53:58.867724 16565 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:58.867913 16565 heartbeater.cc:511] Master 127.3.98.190:34927 requested a full tablet report, sending...
I20260806 00:53:58.868327 16118 ts_manager.cc:194] Registered new tserver with Master: d7d98bb672af45afb3da655a9f4ff8a0 (127.3.98.130:41585)
I20260806 00:53:58.868947 16118 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.98.130:44975
W20260806 00:53:58.949479 16568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:58.949697 16568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:58.949721 16568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:58.951036 16568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:58.951085 16568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:58.951113 16568 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:58.952723 16568 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:34927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:58.952929 16568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:58.953192 16568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:58.959136 16578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:58.959131 16573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:58.959136 16574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:58.959525 16568 server_base.cc:1034] running on GCE node
I20260806 00:53:58.959726 16568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:58.959928 16568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:58.961107 16568 hybrid_clock.cc:648] HybridClock initialized: now 1785977638961088 us; error 29 us; skew 500 ppm
I20260806 00:53:58.962388 16568 webserver.cc:460] Webserver started at http://127.3.98.131:42385/ using document root <none> and password file <none>
I20260806 00:53:58.962642 16568 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:58.962715 16568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:58.962870 16568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:58.964035 16568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "5a3b9865a7fb4951ba5b9b4f7dfa5265"
format_stamp: "Formatted at 2026-08-06 00:53:58 on dist-test-slave-44d2"
server_key: "d713ae1fca51af6a8bb61f804f50a0d3"
server_key_iv: "0932016ca482122fc54757d3fd37db4e"
server_key_version: "encryptionkey@0"
I20260806 00:53:58.964406 16568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "5a3b9865a7fb4951ba5b9b4f7dfa5265"
format_stamp: "Formatted at 2026-08-06 00:53:58 on dist-test-slave-44d2"
server_key: "d713ae1fca51af6a8bb61f804f50a0d3"
server_key_iv: "0932016ca482122fc54757d3fd37db4e"
server_key_version: "encryptionkey@0"
I20260806 00:53:58.965785 16568 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:53:58.966583 16585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:58.966756 16568 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:58.966858 16568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "5a3b9865a7fb4951ba5b9b4f7dfa5265"
format_stamp: "Formatted at 2026-08-06 00:53:58 on dist-test-slave-44d2"
server_key: "d713ae1fca51af6a8bb61f804f50a0d3"
server_key_iv: "0932016ca482122fc54757d3fd37db4e"
server_key_version: "encryptionkey@0"
I20260806 00:53:58.966938 16568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:58.983913 16568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:58.984262 16568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:58.984437 16568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:58.984746 16568 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:58.985113 16568 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:58.985183 16568 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:58.985247 16568 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:58.985277 16568 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:58.991097 16568 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:34065
I20260806 00:53:58.991181 16740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:34065 every 8 connection(s)
I20260806 00:53:58.991614 16568 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:58.997287 16191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:58.992394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:59729 (local address 127.3.98.190:34927)
0806 00:53:58.992452 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:58.992454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:58.992732 (+ 278us) server_negotiation.cc:407] Connection header received
0806 00:53:58.993256 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:58.993258 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:58.993269 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:58.993334 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:58.994136 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.994645 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.995625 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.995818 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.995916 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:58.997016 (+ 1100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:58.997017 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:58.997018 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:58.997023 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:58.997038 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:58.997047 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:58.997096 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:58.997200 (+ 104us) server_negotiation.cc:299] Negotiation successful
0806 00:53:58.997226 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 00:53:58.997476 16744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:58.992366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:34927 (local address 127.3.98.131:59729)
0806 00:53:58.992607 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:58.992651 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:58.993159 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:58.993438 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:58.993441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:58.993451 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:58.994015 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:58.994020 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.994739 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.994739 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:58.995521 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:53:58.995523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:53:58.995915 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:53:58.995916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:53:58.996028 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:53:58.996869 (+ 841us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:58.996870 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:58.996900 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:58.996924 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:58.997118 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:58.997122 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:58.997125 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:58.997178 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 00:53:58.997266 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":107,"threads_started":1}
I20260806 00:53:58.998020 16741 heartbeater.cc:347] Connected to a master server at 127.3.98.190:34927
I20260806 00:53:58.998116 16741 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:58.998263 16741 heartbeater.cc:511] Master 127.3.98.190:34927 requested a full tablet report, sending...
I20260806 00:53:58.998692 16118 ts_manager.cc:194] Registered new tserver with Master: 5a3b9865a7fb4951ba5b9b4f7dfa5265 (127.3.98.131:34065)
I20260806 00:53:58.999105 16118 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.98.131:59729
I20260806 00:53:58.999167 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 16568
I20260806 00:53:58.999253 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:58.999478 3466 external_mini_cluster.cc:1428] Setting key fd398435e07b8540a19c35aa657a8af9
I20260806 00:53:59.000550 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 00:53:59.002542 16191 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:59.001994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44464 (local address 127.3.98.190:34927)
0806 00:53:59.002086 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:59.002088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:59.002182 (+ 94us) server_negotiation.cc:407] Connection header received
0806 00:53:59.002259 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:59.002261 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:59.002272 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:59.002328 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:59.002476 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44464: BlockingRecv error: recv got EOF from 127.0.0.1:44464 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 00:53:59.002620 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 16199
I20260806 00:53:59.019804 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 16388
I20260806 00:53:59.033365 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 16568
I20260806 00:53:59.044442 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 16079
2026-08-06T00:53:59Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (658 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T00:53:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:53:59Z Disabled control of system clock
I20260806 00:53:59.080138 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:39303
--webserver_interface=127.3.98.190
--webserver_port=0
--builtin_ntp_servers=127.3.98.148:45553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:39303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 00:53:59.164337 16756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:59.164666 16756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:59.164690 16756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:59.165795 16756 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:53:59.165830 16756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:59.165843 16756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:59.165856 16756 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:53:59.165868 16756 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:53:59.167161 16756 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:45553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:39303
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:39303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:59.167367 16756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:59.167632 16756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:59.172919 16764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:59.172948 16766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:59.172947 16762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:59.172983 16756 server_base.cc:1034] running on GCE node
I20260806 00:53:59.173411 16756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:59.173738 16756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:59.174919 16756 hybrid_clock.cc:648] HybridClock initialized: now 1785977639174894 us; error 44 us; skew 500 ppm
I20260806 00:53:59.176301 16756 webserver.cc:460] Webserver started at http://127.3.98.190:44427/ using document root <none> and password file <none>
I20260806 00:53:59.176646 16756 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:59.176728 16756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:59.176887 16756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:59.178009 16756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "c990080c89d047fa97f1e70c7800990d"
format_stamp: "Formatted at 2026-08-06 00:53:59 on dist-test-slave-44d2"
server_key: "8b101e7a4b9b7e7718c1e9a33a7a4082"
server_key_iv: "a643e25d4acd84038eef0174ff0f07b7"
server_key_version: "encryptionkey@0"
I20260806 00:53:59.178403 16756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "c990080c89d047fa97f1e70c7800990d"
format_stamp: "Formatted at 2026-08-06 00:53:59 on dist-test-slave-44d2"
server_key: "8b101e7a4b9b7e7718c1e9a33a7a4082"
server_key_iv: "a643e25d4acd84038eef0174ff0f07b7"
server_key_version: "encryptionkey@0"
I20260806 00:53:59.179842 16756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:59.180698 16774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:59.180877 16756 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:53:59.180989 16756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "c990080c89d047fa97f1e70c7800990d"
format_stamp: "Formatted at 2026-08-06 00:53:59 on dist-test-slave-44d2"
server_key: "8b101e7a4b9b7e7718c1e9a33a7a4082"
server_key_iv: "a643e25d4acd84038eef0174ff0f07b7"
server_key_version: "encryptionkey@0"
I20260806 00:53:59.181074 16756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:59.184430 16756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:59.184731 16756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:59.184885 16756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:59.188937 16756 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:39303
I20260806 00:53:59.189000 16847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:39303 every 8 connection(s)
I20260806 00:53:59.189340 16756 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:53:59.190054 16848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:53:59.192917 16848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d: Bootstrap starting.
I20260806 00:53:59.193509 16848 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d: Neither blocks nor log segments found. Creating new log.
I20260806 00:53:59.193851 16848 log.cc:824] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d: Log is configured to *not* fsync() on all Append() calls
I20260806 00:53:59.194547 16848 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d: No bootstrap required, opened a new log
I20260806 00:53:59.195075 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 16756
I20260806 00:53:59.195174 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:53:59.195366 3466 external_mini_cluster.cc:1428] Setting key a13a345061b1545d32ebc38910506aa8
I20260806 00:53:59.196941 16848 raft_consensus.cc:348] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c990080c89d047fa97f1e70c7800990d" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39303 } }
I20260806 00:53:59.197162 16848 raft_consensus.cc:374] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:53:59.197229 16848 raft_consensus.cc:729] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c990080c89d047fa97f1e70c7800990d, State: Initialized, Role: FOLLOWER
I20260806 00:53:59.197386 16848 consensus_queue.cc:260] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c990080c89d047fa97f1e70c7800990d" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39303 } }
I20260806 00:53:59.197471 16848 raft_consensus.cc:388] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:53:59.197507 16848 raft_consensus.cc:482] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:53:59.197571 16848 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:53:59.198128 16848 raft_consensus.cc:504] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c990080c89d047fa97f1e70c7800990d" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39303 } }
I20260806 00:53:59.198253 16848 leader_election.cc:302] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c990080c89d047fa97f1e70c7800990d; no voters:
I20260806 00:53:59.198416 16848 leader_election.cc:288] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:53:59.198434 16853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:59.195889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42684 (local address 127.3.98.190:39303)
0806 00:53:59.196136 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:59.196144 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:59.196177 (+ 33us) server_negotiation.cc:407] Connection header received
0806 00:53:59.196933 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:59.196955 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:59.197005 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:59.197174 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:59.197901 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:59.197905 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:59.197905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:59.197910 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:59.197960 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:59.197972 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:59.198052 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:59.198127 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 00:53:59.198188 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":102,"threads_started":1}
I20260806 00:53:59.198721 16854 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:53:59.198731 16848 sys_catalog.cc:564] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:53:59.198880 16854 raft_consensus.cc:686] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [term 1 LEADER]: Becoming Leader. State: Replica: c990080c89d047fa97f1e70c7800990d, State: Running, Role: LEADER
I20260806 00:53:59.198959 16854 consensus_queue.cc:237] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c990080c89d047fa97f1e70c7800990d" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39303 } }
I20260806 00:53:59.199306 16856 sys_catalog.cc:455] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c990080c89d047fa97f1e70c7800990d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c990080c89d047fa97f1e70c7800990d" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39303 } } }
I20260806 00:53:59.199302 16857 sys_catalog.cc:455] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c990080c89d047fa97f1e70c7800990d. Latest consensus state: current_term: 1 leader_uuid: "c990080c89d047fa97f1e70c7800990d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c990080c89d047fa97f1e70c7800990d" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39303 } } }
I20260806 00:53:59.199409 16856 sys_catalog.cc:458] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:59.199440 16857 sys_catalog.cc:458] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d [sys.catalog]: This master's current role is: LEADER
I20260806 00:53:59.199733 16861 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:53:59.200296 16861 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:53:59.201934 16861 catalog_manager.cc:1347] Generated new cluster ID: 8ebddf4ca0ba4cbfb82282ea2aa478d7
I20260806 00:53:59.201989 16861 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:53:59.217034 16861 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:53:59.217254 16861 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:53:59.225315 16861 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c990080c89d047fa97f1e70c7800990d: Generated new TSK 0
I20260806 00:53:59.225562 16861 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:53:59.233518 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:39303
--builtin_ntp_servers=127.3.98.148:45553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 00:53:59.322136 16879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:59.322350 16879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:59.322374 16879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:59.324229 16879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:59.324281 16879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:59.324309 16879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:53:59.325744 16879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:45553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:39303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:59.326136 16879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:59.326494 16879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:59.331980 16886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:59.332016 16888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:59.332051 16879 server_base.cc:1034] running on GCE node
W20260806 00:53:59.332137 16884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:59.332392 16879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:59.332749 16879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:59.333909 16879 hybrid_clock.cc:648] HybridClock initialized: now 1785977639333891 us; error 33 us; skew 500 ppm
I20260806 00:53:59.335188 16879 webserver.cc:460] Webserver started at http://127.3.98.129:32885/ using document root <none> and password file <none>
I20260806 00:53:59.335459 16879 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:59.335564 16879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:59.335724 16879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:59.336889 16879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "04bc50a625614be89f1f3c3594c5e6ee"
format_stamp: "Formatted at 2026-08-06 00:53:59 on dist-test-slave-44d2"
server_key: "e0a1575965c4f0d3340951dc2d0c7587"
server_key_iv: "b0ca5e71f7320f627884a47a789587a1"
server_key_version: "encryptionkey@0"
I20260806 00:53:59.337270 16879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "04bc50a625614be89f1f3c3594c5e6ee"
format_stamp: "Formatted at 2026-08-06 00:53:59 on dist-test-slave-44d2"
server_key: "e0a1575965c4f0d3340951dc2d0c7587"
server_key_iv: "b0ca5e71f7320f627884a47a789587a1"
server_key_version: "encryptionkey@0"
I20260806 00:53:59.338600 16879 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:53:59.339295 16895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:59.339461 16879 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:59.339571 16879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "04bc50a625614be89f1f3c3594c5e6ee"
format_stamp: "Formatted at 2026-08-06 00:53:59 on dist-test-slave-44d2"
server_key: "e0a1575965c4f0d3340951dc2d0c7587"
server_key_iv: "b0ca5e71f7320f627884a47a789587a1"
server_key_version: "encryptionkey@0"
I20260806 00:53:59.339668 16879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:59.343148 16879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:59.343403 16879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:59.343554 16879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:59.343758 16879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:59.344174 16879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:59.344264 16879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:59.344331 16879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:59.344362 16879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:59.350561 16879 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:42593
I20260806 00:53:59.350598 17056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:42593 every 8 connection(s)
I20260806 00:53:59.350929 16879 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:53:59.354249 16853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:59.351678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:60313 (local address 127.3.98.190:39303)
0806 00:53:59.351722 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:59.351725 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:59.351978 (+ 253us) server_negotiation.cc:407] Connection header received
0806 00:53:59.352523 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:59.352525 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:59.352534 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:59.352602 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:59.353916 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:59.353917 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:59.353918 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:59.353923 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:59.353943 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:59.353948 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:59.354030 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:59.354151 (+ 121us) server_negotiation.cc:299] Negotiation successful
0806 00:53:59.354171 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:53:59.354472 17059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:59.351658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39303 (local address 127.3.98.129:60313)
0806 00:53:59.351854 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:59.351887 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:59.352378 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:59.352687 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:59.352690 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:59.352698 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:59.353652 (+ 954us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:59.353653 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:59.353682 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:59.353713 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:59.354028 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:59.354036 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:59.354040 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:53:59.354160 (+ 120us) client_negotiation.cc:240] Negotiation successful
0806 00:53:59.354225 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":82,"threads_started":1}
I20260806 00:53:59.355042 17057 heartbeater.cc:347] Connected to a master server at 127.3.98.190:39303
I20260806 00:53:59.355134 17057 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:59.355301 17057 heartbeater.cc:511] Master 127.3.98.190:39303 requested a full tablet report, sending...
I20260806 00:53:59.355857 16801 ts_manager.cc:194] Registered new tserver with Master: 04bc50a625614be89f1f3c3594c5e6ee (127.3.98.129:42593)
I20260806 00:53:59.360049 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 16879
I20260806 00:53:59.360131 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:53:59.360334 3466 external_mini_cluster.cc:1428] Setting key ca8b7d734feedaf91e237bf607265fad
I20260806 00:53:59.361308 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:39303
--builtin_ntp_servers=127.3.98.148:45553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 00:53:59.444519 17060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:59.444761 17060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:59.444801 17060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:59.445959 17060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:59.446028 17060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:59.446074 17060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:53:59.447410 17060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:45553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:39303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:59.447688 17060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:59.447991 17060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:59.453078 17066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:59.453068 17069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:59.453087 17067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:59.453348 17060 server_base.cc:1034] running on GCE node
I20260806 00:53:59.453636 17060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:59.453964 17060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:59.455147 17060 hybrid_clock.cc:648] HybridClock initialized: now 1785977639455133 us; error 26 us; skew 500 ppm
I20260806 00:53:59.456387 17060 webserver.cc:460] Webserver started at http://127.3.98.130:36363/ using document root <none> and password file <none>
I20260806 00:53:59.456668 17060 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:59.456717 17060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:59.456810 17060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:59.457867 17060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "4a496613653044f9a3ac46a9977671e4"
format_stamp: "Formatted at 2026-08-06 00:53:59 on dist-test-slave-44d2"
server_key: "660984674748a227d5815f39d022ab0e"
server_key_iv: "3bac0762d3f419f15d3ad7c8cdfb109b"
server_key_version: "encryptionkey@0"
I20260806 00:53:59.458184 17060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "4a496613653044f9a3ac46a9977671e4"
format_stamp: "Formatted at 2026-08-06 00:53:59 on dist-test-slave-44d2"
server_key: "660984674748a227d5815f39d022ab0e"
server_key_iv: "3bac0762d3f419f15d3ad7c8cdfb109b"
server_key_version: "encryptionkey@0"
I20260806 00:53:59.459522 17060 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:53:59.460284 17075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:59.460466 17060 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:53:59.460615 17060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "4a496613653044f9a3ac46a9977671e4"
format_stamp: "Formatted at 2026-08-06 00:53:59 on dist-test-slave-44d2"
server_key: "660984674748a227d5815f39d022ab0e"
server_key_iv: "3bac0762d3f419f15d3ad7c8cdfb109b"
server_key_version: "encryptionkey@0"
I20260806 00:53:59.460702 17060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:59.464056 17060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:59.464323 17060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:59.464474 17060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:59.464718 17060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:59.465045 17060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:59.465109 17060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:59.465150 17060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:59.465176 17060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:59.471186 17060 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:39603
I20260806 00:53:59.471225 17247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:39603 every 8 connection(s)
I20260806 00:53:59.471555 17060 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:53:59.474728 16853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:59.472288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:56843 (local address 127.3.98.190:39303)
0806 00:53:59.472334 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:59.472336 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:59.472665 (+ 329us) server_negotiation.cc:407] Connection header received
0806 00:53:59.473180 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:59.473181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:59.473188 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:59.473256 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:59.474453 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:59.474455 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:59.474455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:59.474461 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:59.474480 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:59.474485 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:59.474560 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:59.474639 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 00:53:59.474655 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 00:53:59.474934 17250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:59.472266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39303 (local address 127.3.98.130:56843)
0806 00:53:59.472462 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:59.472546 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:59.473065 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:59.473330 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:59.473334 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:59.473345 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:59.474243 (+ 898us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:59.474244 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:59.474271 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:59.474298 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:59.474557 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:59.474564 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:59.474567 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:53:59.474651 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 00:53:59.474715 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":72,"threads_started":1}
I20260806 00:53:59.475469 17248 heartbeater.cc:347] Connected to a master server at 127.3.98.190:39303
I20260806 00:53:59.475549 17248 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:59.475721 17248 heartbeater.cc:511] Master 127.3.98.190:39303 requested a full tablet report, sending...
I20260806 00:53:59.476135 16801 ts_manager.cc:194] Registered new tserver with Master: 4a496613653044f9a3ac46a9977671e4 (127.3.98.130:39603)
I20260806 00:53:59.476722 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 17060
I20260806 00:53:59.476835 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:53:59.477061 3466 external_mini_cluster.cc:1428] Setting key 4c23ae4d6d62880dffab7513fa088124
I20260806 00:53:59.477979 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:39303
--builtin_ntp_servers=127.3.98.148:45553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 00:53:59.562124 17251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:53:59.562328 17251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:53:59.562350 17251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:53:59.563519 17251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:53:59.563602 17251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:53:59.563645 17251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:53:59.565068 17251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:45553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:39303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:53:59.565338 17251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:53:59.565634 17251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:53:59.570772 17259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:59.570716 17261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:53:59.570721 17258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:53:59.570926 17251 server_base.cc:1034] running on GCE node
I20260806 00:53:59.571302 17251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:53:59.571507 17251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:53:59.572675 17251 hybrid_clock.cc:648] HybridClock initialized: now 1785977639572668 us; error 38 us; skew 500 ppm
I20260806 00:53:59.573976 17251 webserver.cc:460] Webserver started at http://127.3.98.131:41567/ using document root <none> and password file <none>
I20260806 00:53:59.574218 17251 fs_manager.cc:359] Metadata directory not provided
I20260806 00:53:59.574291 17251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:53:59.574452 17251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:53:59.575547 17251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "f6fd659270f644019b7a9db41042bf21"
format_stamp: "Formatted at 2026-08-06 00:53:59 on dist-test-slave-44d2"
server_key: "9839ada61a7e7ea0e8b39aad0b2f7187"
server_key_iv: "45816f1b083578e4020e00bc5a9ef6ce"
server_key_version: "encryptionkey@0"
I20260806 00:53:59.575925 17251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "f6fd659270f644019b7a9db41042bf21"
format_stamp: "Formatted at 2026-08-06 00:53:59 on dist-test-slave-44d2"
server_key: "9839ada61a7e7ea0e8b39aad0b2f7187"
server_key_iv: "45816f1b083578e4020e00bc5a9ef6ce"
server_key_version: "encryptionkey@0"
I20260806 00:53:59.577358 17251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:53:59.578114 17269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:59.578291 17251 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:53:59.578397 17251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "f6fd659270f644019b7a9db41042bf21"
format_stamp: "Formatted at 2026-08-06 00:53:59 on dist-test-slave-44d2"
server_key: "9839ada61a7e7ea0e8b39aad0b2f7187"
server_key_iv: "45816f1b083578e4020e00bc5a9ef6ce"
server_key_version: "encryptionkey@0"
I20260806 00:53:59.578480 17251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:53:59.581993 17251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:53:59.582262 17251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:53:59.582405 17251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:53:59.582620 17251 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:53:59.582930 17251 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:53:59.582995 17251 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:59.583035 17251 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:53:59.583065 17251 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:53:59.589015 17251 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:44009
I20260806 00:53:59.589051 17424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:44009 every 8 connection(s)
I20260806 00:53:59.589407 17251 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:53:59.592340 16853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:59.590155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:60881 (local address 127.3.98.190:39303)
0806 00:53:59.590231 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:59.590234 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:59.590438 (+ 204us) server_negotiation.cc:407] Connection header received
0806 00:53:59.590889 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:59.590891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:59.590896 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:59.590944 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:59.592140 (+ 1196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:53:59.592141 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:53:59.592142 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:53:59.592145 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:53:59.592156 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:53:59.592160 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:53:59.592203 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0806 00:53:59.592265 (+ 62us) server_negotiation.cc:299] Negotiation successful
0806 00:53:59.592279 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 00:53:59.592550 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:53:59.590146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39303 (local address 127.3.98.131:60881)
0806 00:53:59.590335 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 00:53:59.590367 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0806 00:53:59.590804 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:53:59.591004 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:53:59.591007 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:53:59.591014 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:53:59.592001 (+ 987us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:53:59.592001 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:53:59.592030 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:53:59.592058 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:53:59.592203 (+ 145us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:53:59.592205 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:53:59.592207 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:53:59.592256 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 00:53:59.592303 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
I20260806 00:53:59.593065 17426 heartbeater.cc:347] Connected to a master server at 127.3.98.190:39303
I20260806 00:53:59.593185 17426 heartbeater.cc:464] Registering TS with master...
I20260806 00:53:59.593339 17426 heartbeater.cc:511] Master 127.3.98.190:39303 requested a full tablet report, sending...
I20260806 00:53:59.593569 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 17251
I20260806 00:53:59.593693 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:53:59.593760 16801 ts_manager.cc:194] Registered new tserver with Master: f6fd659270f644019b7a9db41042bf21 (127.3.98.131:44009)
I20260806 00:53:59.593858 3466 external_mini_cluster.cc:1428] Setting key b213878c3054548ac299b08721055bad
I20260806 00:53:59.594661 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 00:53:59.596529 16853 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:53:59.596051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42700 (local address 127.3.98.190:39303)
0806 00:53:59.596119 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 00:53:59.596121 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:53:59.596233 (+ 112us) server_negotiation.cc:407] Connection header received
0806 00:53:59.596268 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:53:59.596269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:53:59.596273 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:53:59.596318 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:53:59.596440 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42700: BlockingRecv error: recv got EOF from 127.0.0.1:42700 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 00:53:59.596621 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 16879
I20260806 00:53:59.615285 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 17060
I20260806 00:53:59.626037 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 17251
I20260806 00:53:59.638299 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 16756
2026-08-06T00:53:59Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (591 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:53:59 dist-test-slave-44d2 krb5kdc[17446](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:53:59 dist-test-slave-44d2 krb5kdc[17446](info): set up 2 sockets
Aug 06 00:53:59 dist-test-slave-44d2 krb5kdc[17446](info): commencing operation
krb5kdc: starting...
W20260806 00:54:00.864709 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:54:00 dist-test-slave-44d2 krb5kdc[17446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:54:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:54:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:54:01.004240 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:42175
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:42175
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:54:01.089452 17462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:54:01.089733 17462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:54:01.089777 17462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:54:01.090950 17462 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:54:01.091030 17462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:54:01.091055 17462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:54:01.091075 17462 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:54:01.091092 17462 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:54:01.092963 17462 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:42175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:42175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:54:01.093286 17462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:54:01.093528 17462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:54:01.098675 17471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:54:01.098835 17462 server_base.cc:1034] running on GCE node
W20260806 00:54:01.098803 17469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:01.098675 17468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:54:01.099167 17462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:54:01.099465 17462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:54:01.100620 17462 hybrid_clock.cc:648] HybridClock initialized: now 1785977641100590 us; error 49 us; skew 500 ppm
Aug 06 00:54:01 dist-test-slave-44d2 krb5kdc[17446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977641, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:54:01.108347 17462 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:54:01.108870 17462 webserver.cc:460] Webserver started at http://127.3.98.190:44695/ using document root <none> and password file <none>
I20260806 00:54:01.109131 17462 fs_manager.cc:359] Metadata directory not provided
I20260806 00:54:01.109210 17462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:54:01.109366 17462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:54:01.110474 17462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "37e0bfd2aca04b53ae2be52a06cf101a"
format_stamp: "Formatted at 2026-08-06 00:54:01 on dist-test-slave-44d2"
server_key: "a5add1d808b697e9676891bfedf78d33"
server_key_iv: "4017707dab633b6191a01fe41ba2ce82"
server_key_version: "encryptionkey@0"
I20260806 00:54:01.110888 17462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "37e0bfd2aca04b53ae2be52a06cf101a"
format_stamp: "Formatted at 2026-08-06 00:54:01 on dist-test-slave-44d2"
server_key: "a5add1d808b697e9676891bfedf78d33"
server_key_iv: "4017707dab633b6191a01fe41ba2ce82"
server_key_version: "encryptionkey@0"
I20260806 00:54:01.112340 17462 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:54:01.113267 17480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:01.113507 17462 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:54:01.113595 17462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "37e0bfd2aca04b53ae2be52a06cf101a"
format_stamp: "Formatted at 2026-08-06 00:54:01 on dist-test-slave-44d2"
server_key: "a5add1d808b697e9676891bfedf78d33"
server_key_iv: "4017707dab633b6191a01fe41ba2ce82"
server_key_version: "encryptionkey@0"
I20260806 00:54:01.113652 17462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:54:01.134917 17462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:54:01.137185 17462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:54:01.137315 17462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:54:01.142061 17462 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:42175
I20260806 00:54:01.142146 17552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:42175 every 8 connection(s)
I20260806 00:54:01.142541 17462 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:54:01.143640 17554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:54:01.146062 17554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a: Bootstrap starting.
I20260806 00:54:01.146685 17554 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a: Neither blocks nor log segments found. Creating new log.
I20260806 00:54:01.147006 17554 log.cc:824] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a: Log is configured to *not* fsync() on all Append() calls
I20260806 00:54:01.147786 17554 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a: No bootstrap required, opened a new log
I20260806 00:54:01.149456 17554 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37e0bfd2aca04b53ae2be52a06cf101a" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42175 } }
I20260806 00:54:01.149642 17554 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:54:01.149693 17554 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37e0bfd2aca04b53ae2be52a06cf101a, State: Initialized, Role: FOLLOWER
I20260806 00:54:01.149904 17554 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37e0bfd2aca04b53ae2be52a06cf101a" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42175 } }
I20260806 00:54:01.150009 17554 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:54:01.150058 17554 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:54:01.150108 17554 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:54:01.150484 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 17462
I20260806 00:54:01.150586 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:54:01.150811 3466 external_mini_cluster.cc:1428] Setting key 8f87fbf2229cbdc34d42bb95c7dda719
I20260806 00:54:01.151304 17554 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37e0bfd2aca04b53ae2be52a06cf101a" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42175 } }
I20260806 00:54:01.151434 17554 leader_election.cc:302] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37e0bfd2aca04b53ae2be52a06cf101a; no voters:
I20260806 00:54:01.151624 17554 leader_election.cc:288] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:54:01.151677 17565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:54:01.151880 17554 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:54:01.151898 17565 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [term 1 LEADER]: Becoming Leader. State: Replica: 37e0bfd2aca04b53ae2be52a06cf101a, State: Running, Role: LEADER
I20260806 00:54:01.152078 17565 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37e0bfd2aca04b53ae2be52a06cf101a" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42175 } }
I20260806 00:54:01.152509 17567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37e0bfd2aca04b53ae2be52a06cf101a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37e0bfd2aca04b53ae2be52a06cf101a" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42175 } } }
I20260806 00:54:01.152804 17567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [sys.catalog]: This master's current role is: LEADER
I20260806 00:54:01.152706 17566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37e0bfd2aca04b53ae2be52a06cf101a. Latest consensus state: current_term: 1 leader_uuid: "37e0bfd2aca04b53ae2be52a06cf101a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37e0bfd2aca04b53ae2be52a06cf101a" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42175 } } }
I20260806 00:54:01.153075 17566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a [sys.catalog]: This master's current role is: LEADER
I20260806 00:54:01.153303 17569 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:54:01.153954 17569 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:54:01.155800 17569 catalog_manager.cc:1347] Generated new cluster ID: 194b9c17aed147acab6e6638b5d05858
I20260806 00:54:01.155856 17569 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:54:01 dist-test-slave-44d2 krb5kdc[17446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:54:01.163368 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.151375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58876 (local address 127.3.98.190:42175)
0806 00:54:01.151611 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:01.151621 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:01.151659 (+ 38us) server_negotiation.cc:407] Connection header received
0806 00:54:01.151792 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:01.151800 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:01.151857 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:01.152913 (+ 1056us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:54:01.153010 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.154569 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.155637 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.156249 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.156397 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.159246 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:54:01.159251 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:54:01.159251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:54:01.159264 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:54:01.161602 (+ 2338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:01.162017 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:01.162020 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:01.162021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:01.162157 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:01.162380 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:01.162381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:01.162381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:01.162726 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:54:01.162900 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:01.162987 (+ 87us) server_negotiation.cc:299] Negotiation successful
0806 00:54:01.163138 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":108,"threads_started":1}
I20260806 00:54:01.165282 17569 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:54:01.165954 17569 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:54:01.170243 17569 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a: Generated new TSK 0
I20260806 00:54:01.170424 17569 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:54:01.200430 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42175
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:54:01.285589 17592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:54:01.285794 17592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:54:01.285817 17592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:54:01.286979 17592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:54:01.287025 17592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:54:01.287051 17592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:54:01.288627 17592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:54:01.288897 17592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:54:01.289170 17592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:54:01.294399 17603 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:01.294390 17600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:01.294394 17601 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:54:01.294801 17592 server_base.cc:1034] running on GCE node
I20260806 00:54:01.295008 17592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:54:01.295258 17592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:54:01.296428 17592 hybrid_clock.cc:648] HybridClock initialized: now 1785977641296429 us; error 50 us; skew 500 ppm
Aug 06 00:54:01 dist-test-slave-44d2 krb5kdc[17446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977641, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:54:01.299196 17592 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:54:01.299678 17592 webserver.cc:460] Webserver started at http://127.3.98.129:40191/ using document root <none> and password file <none>
I20260806 00:54:01.299901 17592 fs_manager.cc:359] Metadata directory not provided
I20260806 00:54:01.299942 17592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:54:01.300042 17592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:54:01.301143 17592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "06a76bee1cad4293b69ad9e89e0640ce"
format_stamp: "Formatted at 2026-08-06 00:54:01 on dist-test-slave-44d2"
server_key: "f1f989a7777a108d78a7fbe0675c7ca4"
server_key_iv: "15008e097e05dd527b448fb7a63b4cbb"
server_key_version: "encryptionkey@0"
I20260806 00:54:01.301450 17592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "06a76bee1cad4293b69ad9e89e0640ce"
format_stamp: "Formatted at 2026-08-06 00:54:01 on dist-test-slave-44d2"
server_key: "f1f989a7777a108d78a7fbe0675c7ca4"
server_key_iv: "15008e097e05dd527b448fb7a63b4cbb"
server_key_version: "encryptionkey@0"
I20260806 00:54:01.302773 17592 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:54:01.303520 17613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:01.303755 17592 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:54:01.303869 17592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "06a76bee1cad4293b69ad9e89e0640ce"
format_stamp: "Formatted at 2026-08-06 00:54:01 on dist-test-slave-44d2"
server_key: "f1f989a7777a108d78a7fbe0675c7ca4"
server_key_iv: "15008e097e05dd527b448fb7a63b4cbb"
server_key_version: "encryptionkey@0"
I20260806 00:54:01.303983 17592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:54:01.319893 17592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:54:01.322063 17592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:54:01.322253 17592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:54:01.322544 17592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:54:01.322919 17592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:54:01.322961 17592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:01.322986 17592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:54:01.323045 17592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:01.329819 17592 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:34611
I20260806 00:54:01.329860 17764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:34611 every 8 connection(s)
I20260806 00:54:01.330252 17592 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:54:01.336185 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 17592
I20260806 00:54:01.336308 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:54:01.336591 3466 external_mini_cluster.cc:1428] Setting key dbd3a38d5d503aa7528dd1ca4d76568e
Aug 06 00:54:01 dist-test-slave-44d2 krb5kdc[17446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977641, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:54:01.340560 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.331154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:59713 (local address 127.3.98.190:42175)
0806 00:54:01.331232 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:01.331234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:01.331442 (+ 208us) server_negotiation.cc:407] Connection header received
0806 00:54:01.331942 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:01.331943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:01.331961 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:01.332028 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:54:01.333072 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.333587 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.334585 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.334793 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.334858 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.337405 (+ 2547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:54:01.337407 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:54:01.337407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:54:01.337413 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:54:01.339076 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:01.339501 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:01.339503 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:01.339504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:01.339576 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:01.339858 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:01.339859 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:01.339860 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:01.339976 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:54:01.340057 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:01.340347 (+ 290us) server_negotiation.cc:299] Negotiation successful
0806 00:54:01.340441 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 00:54:01.340740 17771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.331126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:42175 (local address 127.3.98.129:59713)
0806 00:54:01.331311 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:01.331349 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:01.331832 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:01.332121 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:01.332124 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:01.332775 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:54:01.332975 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.332980 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.333675 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.333676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.334487 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.334489 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.334878 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.334879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.334978 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.335499 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:54:01.335507 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:54:01.337270 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:54:01.339171 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:54:01.339180 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:54:01.339182 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:54:01.339416 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:54:01.339661 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:54:01.339662 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:54:01.339662 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:54:01.339779 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:54:01.340048 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:54:01.340056 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:54:01.340205 (+ 149us) client_negotiation.cc:769] Sending connection context
0806 00:54:01.340321 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 00:54:01.340483 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":100,"threads_started":1}
I20260806 00:54:01.341418 17766 heartbeater.cc:347] Connected to a master server at 127.3.98.190:42175
I20260806 00:54:01.341554 17766 heartbeater.cc:464] Registering TS with master...
I20260806 00:54:01.341755 17766 heartbeater.cc:511] Master 127.3.98.190:42175 requested a full tablet report, sending...
I20260806 00:54:01.342468 17500 ts_manager.cc:194] Registered new tserver with Master: 06a76bee1cad4293b69ad9e89e0640ce (127.3.98.129:34611)
I20260806 00:54:01.343459 17500 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:59713
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:54:01.367808 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42175
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:54:01.456362 17774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:54:01.456621 17774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:54:01.456650 17774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:54:01.457779 17774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:54:01.457823 17774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:54:01.457880 17774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:54:01.459306 17774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:54:01.459560 17774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:54:01.459800 17774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:54:01.465050 17785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:01.465050 17782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:01.465081 17781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:54:01.465235 17774 server_base.cc:1034] running on GCE node
I20260806 00:54:01.465487 17774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:54:01.465741 17774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:54:01.466888 17774 hybrid_clock.cc:648] HybridClock initialized: now 1785977641466870 us; error 35 us; skew 500 ppm
Aug 06 00:54:01 dist-test-slave-44d2 krb5kdc[17446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977641, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:54:01.469493 17774 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:54:01.469925 17774 webserver.cc:460] Webserver started at http://127.3.98.130:41149/ using document root <none> and password file <none>
I20260806 00:54:01.470185 17774 fs_manager.cc:359] Metadata directory not provided
I20260806 00:54:01.470259 17774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:54:01.470412 17774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:54:01.471473 17774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "c4ece54a5b4c40d4be92df0959435f26"
format_stamp: "Formatted at 2026-08-06 00:54:01 on dist-test-slave-44d2"
server_key: "125a6d377b2a406c2625b89f5eebaa4f"
server_key_iv: "c2064f4ea11aee5ad9154e1b26f141d2"
server_key_version: "encryptionkey@0"
I20260806 00:54:01.471843 17774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "c4ece54a5b4c40d4be92df0959435f26"
format_stamp: "Formatted at 2026-08-06 00:54:01 on dist-test-slave-44d2"
server_key: "125a6d377b2a406c2625b89f5eebaa4f"
server_key_iv: "c2064f4ea11aee5ad9154e1b26f141d2"
server_key_version: "encryptionkey@0"
I20260806 00:54:01.473348 17774 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:54:01.474115 17803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:01.474294 17774 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:54:01.474399 17774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "c4ece54a5b4c40d4be92df0959435f26"
format_stamp: "Formatted at 2026-08-06 00:54:01 on dist-test-slave-44d2"
server_key: "125a6d377b2a406c2625b89f5eebaa4f"
server_key_iv: "c2064f4ea11aee5ad9154e1b26f141d2"
server_key_version: "encryptionkey@0"
I20260806 00:54:01.474483 17774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:54:01.488377 17774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:54:01.490218 17774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:54:01.490388 17774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:54:01.490613 17774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:54:01.490934 17774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:54:01.490993 17774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:01.491034 17774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:54:01.491060 17774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:01.497282 17774 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:43963
I20260806 00:54:01.497372 17953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:43963 every 8 connection(s)
I20260806 00:54:01.497673 17774 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
Aug 06 00:54:01 dist-test-slave-44d2 krb5kdc[17446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977641, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:54:01.504035 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 17774
I20260806 00:54:01.504160 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:54:01.504361 3466 external_mini_cluster.cc:1428] Setting key 3870471d51006a460c0f92b574c18065
I20260806 00:54:01.507495 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.498421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:40097 (local address 127.3.98.190:42175)
0806 00:54:01.498494 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:01.498496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:01.498723 (+ 227us) server_negotiation.cc:407] Connection header received
0806 00:54:01.499216 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:01.499217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:01.499228 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:01.499289 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:54:01.500236 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.500854 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.501817 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.502008 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.502060 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.504189 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:54:01.504191 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:54:01.504191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:54:01.504199 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:54:01.505919 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:01.506431 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:01.506431 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:01.506432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:01.506484 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:01.506777 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:01.506777 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:01.506778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:01.506903 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:54:01.507031 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:01.507323 (+ 292us) server_negotiation.cc:299] Negotiation successful
0806 00:54:01.507405 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 00:54:01.507697 17958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.498385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:42175 (local address 127.3.98.130:40097)
0806 00:54:01.498584 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:01.498627 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:01.499129 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:01.499359 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:01.499363 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:01.499953 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:54:01.500150 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.500155 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.500939 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.500940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.501741 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.501743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.502083 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.502084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.502182 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.502661 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:54:01.502670 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:54:01.504043 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:54:01.506007 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:54:01.506016 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:54:01.506018 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:54:01.506352 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:54:01.506552 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:54:01.506553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:54:01.506554 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:54:01.506701 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:54:01.507031 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:54:01.507041 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:54:01.507171 (+ 130us) client_negotiation.cc:769] Sending connection context
0806 00:54:01.507284 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 00:54:01.507440 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":114,"threads_started":1}
I20260806 00:54:01.508314 17955 heartbeater.cc:347] Connected to a master server at 127.3.98.190:42175
I20260806 00:54:01.508499 17955 heartbeater.cc:464] Registering TS with master...
I20260806 00:54:01.508692 17955 heartbeater.cc:511] Master 127.3.98.190:42175 requested a full tablet report, sending...
I20260806 00:54:01.509117 17500 ts_manager.cc:194] Registered new tserver with Master: c4ece54a5b4c40d4be92df0959435f26 (127.3.98.130:43963)
I20260806 00:54:01.509502 17500 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:40097
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:54:01.531849 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42175
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:54:01.615000 17963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:54:01.615269 17963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:54:01.615311 17963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:54:01.616600 17963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:54:01.616674 17963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:54:01.616724 17963 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:54:01.618307 17963 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:54:01.618618 17963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:54:01.618870 17963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:54:01.624120 17969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:01.624142 17972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:01.624120 17974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:54:01.624432 17963 server_base.cc:1034] running on GCE node
I20260806 00:54:01.624680 17963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:54:01.624941 17963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:54:01.626116 17963 hybrid_clock.cc:648] HybridClock initialized: now 1785977641626116 us; error 43 us; skew 500 ppm
Aug 06 00:54:01 dist-test-slave-44d2 krb5kdc[17446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977641, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:54:01.628695 17963 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:54:01.629197 17963 webserver.cc:460] Webserver started at http://127.3.98.131:38489/ using document root <none> and password file <none>
I20260806 00:54:01.629431 17963 fs_manager.cc:359] Metadata directory not provided
I20260806 00:54:01.629501 17963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:54:01.629662 17963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:54:01.630735 17963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "330b8fdd9b954295858cc14cf12541d3"
format_stamp: "Formatted at 2026-08-06 00:54:01 on dist-test-slave-44d2"
server_key: "cb067fe0ac075648a9a0d27c1d6f4a2e"
server_key_iv: "3ff76df778c50cc80ebc45405b6a5cab"
server_key_version: "encryptionkey@0"
I20260806 00:54:01.631124 17963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "330b8fdd9b954295858cc14cf12541d3"
format_stamp: "Formatted at 2026-08-06 00:54:01 on dist-test-slave-44d2"
server_key: "cb067fe0ac075648a9a0d27c1d6f4a2e"
server_key_iv: "3ff76df778c50cc80ebc45405b6a5cab"
server_key_version: "encryptionkey@0"
I20260806 00:54:01.632563 17963 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260806 00:54:01.633342 17985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:01.633512 17963 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:54:01.633617 17963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "330b8fdd9b954295858cc14cf12541d3"
format_stamp: "Formatted at 2026-08-06 00:54:01 on dist-test-slave-44d2"
server_key: "cb067fe0ac075648a9a0d27c1d6f4a2e"
server_key_iv: "3ff76df778c50cc80ebc45405b6a5cab"
server_key_version: "encryptionkey@0"
I20260806 00:54:01.633700 17963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:54:01.645959 17963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:54:01.648168 17963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:54:01.648343 17963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:54:01.648689 17963 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:54:01.649021 17963 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:54:01.649088 17963 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:01.649149 17963 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:54:01.649179 17963 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:01.655989 17963 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:46267
I20260806 00:54:01.656060 18138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:46267 every 8 connection(s)
I20260806 00:54:01.656442 17963 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:54:01.657116 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 17963
I20260806 00:54:01.657215 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:54:01.657482 3466 external_mini_cluster.cc:1428] Setting key e12c55ca862d7c62838af85637456004
Aug 06 00:54:01 dist-test-slave-44d2 krb5kdc[17446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977641, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:54:01.668956 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.657339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:59799 (local address 127.3.98.190:42175)
0806 00:54:01.657400 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:01.657402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:01.657740 (+ 338us) server_negotiation.cc:407] Connection header received
0806 00:54:01.658613 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:01.658615 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:01.658629 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:01.658703 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:54:01.659813 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.660382 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.661726 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.661956 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.662056 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.665662 (+ 3606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:54:01.665664 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:54:01.665665 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:54:01.665675 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:54:01.667483 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:01.667926 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:01.667927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:01.667928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:01.667985 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:01.668237 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:01.668238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:01.668238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:01.668355 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:54:01.668433 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:01.668763 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 00:54:01.668836 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 00:54:01.669222 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.657323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:42175 (local address 127.3.98.131:59799)
0806 00:54:01.657495 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:01.657539 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:01.658448 (+ 909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:01.658788 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:01.658793 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:01.659467 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:54:01.659685 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.659691 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.660527 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.660528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.661606 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.661608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.662068 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.662069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.662210 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.663267 (+ 1057us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:54:01.663280 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:54:01.665508 (+ 2228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:54:01.667570 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:54:01.667578 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:54:01.667580 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:54:01.667836 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:54:01.668054 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:54:01.668055 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:54:01.668055 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:54:01.668174 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:54:01.668419 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:54:01.668425 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:54:01.668637 (+ 212us) client_negotiation.cc:769] Sending connection context
0806 00:54:01.668744 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 00:54:01.668932 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":102,"threads_started":1}
I20260806 00:54:01.669956 18140 heartbeater.cc:347] Connected to a master server at 127.3.98.190:42175
I20260806 00:54:01.670089 18140 heartbeater.cc:464] Registering TS with master...
I20260806 00:54:01.670305 18140 heartbeater.cc:511] Master 127.3.98.190:42175 requested a full tablet report, sending...
I20260806 00:54:01.670779 17500 ts_manager.cc:194] Registered new tserver with Master: 330b8fdd9b954295858cc14cf12541d3 (127.3.98.131:46267)
I20260806 00:54:01.671186 17500 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:59799
I20260806 00:54:01.680933 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:54:01.689260 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.682357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58890 (local address 127.3.98.190:42175)
0806 00:54:01.682444 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:01.682446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:01.682513 (+ 67us) server_negotiation.cc:407] Connection header received
0806 00:54:01.682560 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:01.682561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:01.682572 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:01.682622 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:54:01.683185 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.683672 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.684429 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.684682 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.684737 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.686378 (+ 1641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:54:01.686379 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:54:01.686379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:54:01.686385 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:54:01.687879 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:01.688402 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:01.688403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:01.688403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:01.688463 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:01.688700 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:01.688701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:01.688701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:01.688860 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:54:01.688939 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:01.689081 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 00:54:01.689149 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 00:54:01.691380 17500 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58890:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:54:01.693162 17500 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:54:01.700062 18160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.695744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:46267 (local address 127.0.0.1:42752)
0806 00:54:01.696053 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:01.696064 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:01.696136 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:01.696736 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:01.696736 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:01.696738 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:54:01.696773 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.696774 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.697970 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.697971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.699038 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.699039 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.699744 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.699745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.699831 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.699845 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 00:54:01.699914 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 00:54:01.699975 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":100,"threads_started":1}
I20260806 00:54:01.700181 18165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.695976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:34611 (local address 127.0.0.1:52706)
0806 00:54:01.696096 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:01.696108 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:01.696153 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:01.696662 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:01.696663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:01.696665 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:54:01.696721 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.696723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.697633 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.697634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.698909 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.698912 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.699934 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.699935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.700012 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.700018 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 00:54:01.700067 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 00:54:01.700106 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":1,"thread_start_us":78,"threads_started":1}
I20260806 00:54:01.700138 18163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.695878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37810 (local address 127.3.98.130:43963)
0806 00:54:01.696172 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:01.696177 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:01.696187 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:54:01.696226 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:01.696228 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:01.696242 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:01.696407 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:54:01.696597 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.697784 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.699047 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.699758 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.699862 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.699924 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:01.700010 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 00:54:01.700057 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":77,"threads_started":1}
I20260806 00:54:01.700309 18158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.695737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:43963 (local address 127.0.0.1:37810)
0806 00:54:01.695896 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:01.695939 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:01.696010 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:01.696404 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:01.696407 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:01.696410 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:54:01.696504 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.696507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.697926 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.697928 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.698914 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.698916 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.699871 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.699872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.699931 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.699934 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:54:01.699993 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 00:54:01.700031 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":48,"thread_start_us":48,"threads_started":1}
I20260806 00:54:01.700436 18166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.696207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52706 (local address 127.3.98.129:34611)
0806 00:54:01.696390 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:01.696395 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:01.696406 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:54:01.696451 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:01.696453 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:01.696470 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:01.696570 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:54:01.696809 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.697518 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.699009 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.699759 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.699833 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.699895 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:01.700282 (+ 387us) server_negotiation.cc:299] Negotiation successful
0806 00:54:01.700332 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":107,"threads_started":1}
I20260806 00:54:01.700915 18161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.695837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42752 (local address 127.3.98.131:46267)
0806 00:54:01.696578 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:01.696582 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:01.696592 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:54:01.696633 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:01.696636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:01.696651 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:01.696724 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:54:01.696829 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.697866 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.699143 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.699638 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.699730 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.699795 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:01.700802 (+ 1007us) server_negotiation.cc:299] Negotiation successful
0806 00:54:01.700852 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":113,"threads_started":1}
I20260806 00:54:01.701126 17676 tablet_service.cc:1467] Processing CreateTablet for tablet 818e4395df4f4a13bb90ca9816d66e26 (DEFAULT_TABLE table=test-table [id=94e879ed551845d4aa0dda4a038c429b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:54:01.701126 17866 tablet_service.cc:1467] Processing CreateTablet for tablet 818e4395df4f4a13bb90ca9816d66e26 (DEFAULT_TABLE table=test-table [id=94e879ed551845d4aa0dda4a038c429b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:54:01.701519 17676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818e4395df4f4a13bb90ca9816d66e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:54:01.701519 17866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818e4395df4f4a13bb90ca9816d66e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:54:01.705072 18168 tablet_bootstrap.cc:492] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26: Bootstrap starting.
I20260806 00:54:01.705230 18048 tablet_service.cc:1467] Processing CreateTablet for tablet 818e4395df4f4a13bb90ca9816d66e26 (DEFAULT_TABLE table=test-table [id=94e879ed551845d4aa0dda4a038c429b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:54:01.705453 18169 tablet_bootstrap.cc:492] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce: Bootstrap starting.
I20260806 00:54:01.705606 18048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818e4395df4f4a13bb90ca9816d66e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:54:01.705873 18168 tablet_bootstrap.cc:654] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26: Neither blocks nor log segments found. Creating new log.
I20260806 00:54:01.705988 18169 tablet_bootstrap.cc:654] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce: Neither blocks nor log segments found. Creating new log.
I20260806 00:54:01.706451 18168 log.cc:824] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26: Log is configured to *not* fsync() on all Append() calls
I20260806 00:54:01.706408 18169 log.cc:824] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce: Log is configured to *not* fsync() on all Append() calls
I20260806 00:54:01.707233 18169 tablet_bootstrap.cc:492] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce: No bootstrap required, opened a new log
I20260806 00:54:01.707281 18169 ts_tablet_manager.cc:1397] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:54:01.707509 18168 tablet_bootstrap.cc:492] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26: No bootstrap required, opened a new log
I20260806 00:54:01.707841 18168 ts_tablet_manager.cc:1397] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 00:54:01.709129 18172 tablet_bootstrap.cc:492] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3: Bootstrap starting.
I20260806 00:54:01.708951 18169 raft_consensus.cc:348] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330b8fdd9b954295858cc14cf12541d3" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 46267 } } peers { permanent_uuid: "c4ece54a5b4c40d4be92df0959435f26" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43963 } } peers { permanent_uuid: "06a76bee1cad4293b69ad9e89e0640ce" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34611 } }
I20260806 00:54:01.709383 18169 raft_consensus.cc:374] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:54:01.709473 18169 raft_consensus.cc:729] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06a76bee1cad4293b69ad9e89e0640ce, State: Initialized, Role: FOLLOWER
I20260806 00:54:01.709620 18169 consensus_queue.cc:260] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330b8fdd9b954295858cc14cf12541d3" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 46267 } } peers { permanent_uuid: "c4ece54a5b4c40d4be92df0959435f26" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43963 } } peers { permanent_uuid: "06a76bee1cad4293b69ad9e89e0640ce" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34611 } }
I20260806 00:54:01.709869 18172 tablet_bootstrap.cc:654] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3: Neither blocks nor log segments found. Creating new log.
I20260806 00:54:01.709932 18169 ts_tablet_manager.cc:1428] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:54:01.710103 17766 heartbeater.cc:503] Master 127.3.98.190:42175 was elected leader, sending a full tablet report...
I20260806 00:54:01.709998 18168 raft_consensus.cc:348] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330b8fdd9b954295858cc14cf12541d3" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 46267 } } peers { permanent_uuid: "c4ece54a5b4c40d4be92df0959435f26" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43963 } } peers { permanent_uuid: "06a76bee1cad4293b69ad9e89e0640ce" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34611 } }
I20260806 00:54:01.710147 18168 raft_consensus.cc:374] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:54:01.710171 18168 raft_consensus.cc:729] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4ece54a5b4c40d4be92df0959435f26, State: Initialized, Role: FOLLOWER
I20260806 00:54:01.710278 18168 consensus_queue.cc:260] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330b8fdd9b954295858cc14cf12541d3" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 46267 } } peers { permanent_uuid: "c4ece54a5b4c40d4be92df0959435f26" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43963 } } peers { permanent_uuid: "06a76bee1cad4293b69ad9e89e0640ce" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34611 } }
I20260806 00:54:01.710486 18172 log.cc:824] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3: Log is configured to *not* fsync() on all Append() calls
I20260806 00:54:01.710561 18168 ts_tablet_manager.cc:1428] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:54:01.710811 17955 heartbeater.cc:503] Master 127.3.98.190:42175 was elected leader, sending a full tablet report...
I20260806 00:54:01.711434 18172 tablet_bootstrap.cc:492] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3: No bootstrap required, opened a new log
I20260806 00:54:01.711501 18172 ts_tablet_manager.cc:1397] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:54:01.712895 18172 raft_consensus.cc:348] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330b8fdd9b954295858cc14cf12541d3" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 46267 } } peers { permanent_uuid: "c4ece54a5b4c40d4be92df0959435f26" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43963 } } peers { permanent_uuid: "06a76bee1cad4293b69ad9e89e0640ce" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34611 } }
I20260806 00:54:01.713040 18172 raft_consensus.cc:374] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:54:01.713086 18172 raft_consensus.cc:729] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330b8fdd9b954295858cc14cf12541d3, State: Initialized, Role: FOLLOWER
I20260806 00:54:01.713195 18172 consensus_queue.cc:260] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330b8fdd9b954295858cc14cf12541d3" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 46267 } } peers { permanent_uuid: "c4ece54a5b4c40d4be92df0959435f26" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43963 } } peers { permanent_uuid: "06a76bee1cad4293b69ad9e89e0640ce" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34611 } }
I20260806 00:54:01.713480 18172 ts_tablet_manager.cc:1428] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:54:01.713510 18140 heartbeater.cc:503] Master 127.3.98.190:42175 was elected leader, sending a full tablet report...
W20260806 00:54:01.748268 17956 tablet.cc:2369] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 00:54:01.831198 17769 tablet.cc:2369] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:54:01.881100 18174 raft_consensus.cc:482] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:54:01.881304 18174 raft_consensus.cc:504] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330b8fdd9b954295858cc14cf12541d3" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 46267 } } peers { permanent_uuid: "c4ece54a5b4c40d4be92df0959435f26" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43963 } } peers { permanent_uuid: "06a76bee1cad4293b69ad9e89e0640ce" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34611 } }
I20260806 00:54:01.881793 18174 leader_election.cc:288] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 330b8fdd9b954295858cc14cf12541d3 (127.3.98.131:46267), 06a76bee1cad4293b69ad9e89e0640ce (127.3.98.129:34611)
I20260806 00:54:01.886538 18161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.882116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:34485 (local address 127.3.98.131:46267)
0806 00:54:01.882185 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:01.882188 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:01.882201 (+ 13us) server_negotiation.cc:407] Connection header received
0806 00:54:01.882233 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:01.882234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:01.882245 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:01.882351 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:54:01.882590 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.883562 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.885508 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.886110 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.886188 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.886198 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:01.886416 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 00:54:01.886463 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 00:54:01.886544 18166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.882284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:48419 (local address 127.3.98.129:34611)
0806 00:54:01.882407 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:01.882409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:01.882559 (+ 150us) server_negotiation.cc:407] Connection header received
0806 00:54:01.882593 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:01.882594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:01.882609 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:01.882684 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:54:01.882874 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.883640 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.885508 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.886098 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.886188 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.886198 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:01.886447 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 00:54:01.886485 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 00:54:01.886591 17958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.882024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:46267 (local address 127.3.98.130:34485)
0806 00:54:01.882085 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:01.882098 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:01.882146 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:01.882404 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:01.882405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:01.882407 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:54:01.882493 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.882496 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.883726 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.883728 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.885373 (+ 1645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.885376 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.886214 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.886216 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.886318 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.886320 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:54:01.886396 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 00:54:01.886453 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":61}
I20260806 00:54:01.886600 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.882184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:34611 (local address 127.3.98.130:48419)
0806 00:54:01.882472 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:01.882483 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:01.882544 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:01.882710 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:01.882711 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:01.882713 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:54:01.882779 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.882780 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.883745 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.883746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.885382 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:01.885384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.886214 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.886216 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:01.886316 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.886321 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:54:01.886437 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 00:54:01.886468 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":160,"thread_start_us":138,"threads_started":1}
I20260806 00:54:01.886998 18075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818e4395df4f4a13bb90ca9816d66e26" candidate_uuid: "c4ece54a5b4c40d4be92df0959435f26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330b8fdd9b954295858cc14cf12541d3" is_pre_election: true
I20260806 00:54:01.887035 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818e4395df4f4a13bb90ca9816d66e26" candidate_uuid: "c4ece54a5b4c40d4be92df0959435f26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a76bee1cad4293b69ad9e89e0640ce" is_pre_election: true
I20260806 00:54:01.887197 18075 raft_consensus.cc:2454] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4ece54a5b4c40d4be92df0959435f26 in term 0.
I20260806 00:54:01.887229 17700 raft_consensus.cc:2454] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4ece54a5b4c40d4be92df0959435f26 in term 0.
I20260806 00:54:01.887467 17806 leader_election.cc:302] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a76bee1cad4293b69ad9e89e0640ce, c4ece54a5b4c40d4be92df0959435f26; no voters:
I20260806 00:54:01.887629 18174 raft_consensus.cc:2781] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:54:01.887723 18174 raft_consensus.cc:482] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:54:01.887764 18174 raft_consensus.cc:3037] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:54:01.888824 18174 raft_consensus.cc:504] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330b8fdd9b954295858cc14cf12541d3" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 46267 } } peers { permanent_uuid: "c4ece54a5b4c40d4be92df0959435f26" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43963 } } peers { permanent_uuid: "06a76bee1cad4293b69ad9e89e0640ce" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34611 } }
I20260806 00:54:01.889001 18174 leader_election.cc:288] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [CANDIDATE]: Term 1 election: Requested vote from peers 330b8fdd9b954295858cc14cf12541d3 (127.3.98.131:46267), 06a76bee1cad4293b69ad9e89e0640ce (127.3.98.129:34611)
I20260806 00:54:01.889276 18075 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818e4395df4f4a13bb90ca9816d66e26" candidate_uuid: "c4ece54a5b4c40d4be92df0959435f26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330b8fdd9b954295858cc14cf12541d3"
I20260806 00:54:01.889329 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818e4395df4f4a13bb90ca9816d66e26" candidate_uuid: "c4ece54a5b4c40d4be92df0959435f26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06a76bee1cad4293b69ad9e89e0640ce"
I20260806 00:54:01.889394 18075 raft_consensus.cc:3037] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:54:01.889436 17700 raft_consensus.cc:3037] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:54:01.890205 18075 raft_consensus.cc:2454] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4ece54a5b4c40d4be92df0959435f26 in term 1.
I20260806 00:54:01.890265 17700 raft_consensus.cc:2454] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4ece54a5b4c40d4be92df0959435f26 in term 1.
I20260806 00:54:01.890435 17806 leader_election.cc:302] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06a76bee1cad4293b69ad9e89e0640ce, c4ece54a5b4c40d4be92df0959435f26; no voters:
I20260806 00:54:01.890558 18174 raft_consensus.cc:2781] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:54:01.890791 18174 raft_consensus.cc:686] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [term 1 LEADER]: Becoming Leader. State: Replica: c4ece54a5b4c40d4be92df0959435f26, State: Running, Role: LEADER
I20260806 00:54:01.890926 18174 consensus_queue.cc:237] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330b8fdd9b954295858cc14cf12541d3" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 46267 } } peers { permanent_uuid: "c4ece54a5b4c40d4be92df0959435f26" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43963 } } peers { permanent_uuid: "06a76bee1cad4293b69ad9e89e0640ce" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34611 } }
I20260806 00:54:01.891959 17497 catalog_manager.cc:5495] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 reported cstate change: term changed from 0 to 1, leader changed from <none> to c4ece54a5b4c40d4be92df0959435f26 (127.3.98.130). New cstate: current_term: 1 leader_uuid: "c4ece54a5b4c40d4be92df0959435f26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330b8fdd9b954295858cc14cf12541d3" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 46267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4ece54a5b4c40d4be92df0959435f26" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06a76bee1cad4293b69ad9e89e0640ce" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34611 } health_report { overall_health: UNKNOWN } } }
W20260806 00:54:01.907143 18141 tablet.cc:2369] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:54:01.931620 18163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.929259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37824 (local address 127.3.98.130:43963)
0806 00:54:01.929319 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:01.929321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:01.929331 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:54:01.929422 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:01.929423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:01.929445 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:01.929515 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:54:01.929642 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.930112 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.930823 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:01.931037 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:01.931093 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:01.931296 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:54:01.931400 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:54:01.931464 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:01.931524 (+ 60us) server_negotiation.cc:299] Negotiation successful
0806 00:54:01.931542 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 00:54:01.933617 18075 raft_consensus.cc:1261] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3 [term 1 FOLLOWER]: Refusing update from remote peer c4ece54a5b4c40d4be92df0959435f26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:54:01.933636 17700 raft_consensus.cc:1261] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce [term 1 FOLLOWER]: Refusing update from remote peer c4ece54a5b4c40d4be92df0959435f26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:54:01.934005 18178 consensus_queue.cc:1035] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330b8fdd9b954295858cc14cf12541d3" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 46267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:54:01.934146 18174 consensus_queue.cc:1035] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06a76bee1cad4293b69ad9e89e0640ce" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:54:01.939466 17497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:54:01.939591 17497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58890:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:54:01.940411 17497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 37e0bfd2aca04b53ae2be52a06cf101a: Sending DeleteTablet for 3 replicas of tablet 818e4395df4f4a13bb90ca9816d66e26
I20260806 00:54:01.940825 18048 tablet_service.cc:1514] Processing DeleteTablet for tablet 818e4395df4f4a13bb90ca9816d66e26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:54:01 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:42752
I20260806 00:54:01.940850 17676 tablet_service.cc:1514] Processing DeleteTablet for tablet 818e4395df4f4a13bb90ca9816d66e26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:54:01 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:52706
I20260806 00:54:01.941176 18192 tablet_replica.cc:330] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce: stopping tablet replica
I20260806 00:54:01.941181 17866 tablet_service.cc:1514] Processing DeleteTablet for tablet 818e4395df4f4a13bb90ca9816d66e26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:54:01 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:37810
I20260806 00:54:01.941284 18192 raft_consensus.cc:2229] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:54:01.941401 18192 raft_consensus.cc:2258] T 818e4395df4f4a13bb90ca9816d66e26 P 06a76bee1cad4293b69ad9e89e0640ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:54:01.941610 18193 tablet_replica.cc:330] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3: stopping tablet replica
I20260806 00:54:01.941740 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 17592
I20260806 00:54:01.941779 18193 raft_consensus.cc:2229] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:54:01.941882 18193 raft_consensus.cc:2258] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:54:01.947069 18193 ts_tablet_manager.cc:1905] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:54:01.947489 18195 tablet_replica.cc:330] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26: stopping tablet replica
I20260806 00:54:01.947638 18195 raft_consensus.cc:2229] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:54:01.947777 18195 raft_consensus.cc:2258] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:54:01.949409 18195 ts_tablet_manager.cc:1905] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:54:01.949625 18193 ts_tablet_manager.cc:1918] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:54:01.949764 18193 log.cc:1196] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/818e4395df4f4a13bb90ca9816d66e26
I20260806 00:54:01.950205 18193 ts_tablet_manager.cc:1939] T 818e4395df4f4a13bb90ca9816d66e26 P 330b8fdd9b954295858cc14cf12541d3: Deleting consensus metadata
I20260806 00:54:01.950837 17481 catalog_manager.cc:4841] TS 330b8fdd9b954295858cc14cf12541d3 (127.3.98.131:46267): tablet 818e4395df4f4a13bb90ca9816d66e26 (table test-table [id=94e879ed551845d4aa0dda4a038c429b]) successfully deleted
I20260806 00:54:01.951145 18195 ts_tablet_manager.cc:1918] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:54:01.951229 18195 log.cc:1196] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/818e4395df4f4a13bb90ca9816d66e26
I20260806 00:54:01.951573 18195 ts_tablet_manager.cc:1939] T 818e4395df4f4a13bb90ca9816d66e26 P c4ece54a5b4c40d4be92df0959435f26: Deleting consensus metadata
I20260806 00:54:01.952035 17482 catalog_manager.cc:4841] TS c4ece54a5b4c40d4be92df0959435f26 (127.3.98.130:43963): tablet 818e4395df4f4a13bb90ca9816d66e26 (table test-table [id=94e879ed551845d4aa0dda4a038c429b]) successfully deleted
W20260806 00:54:01.955725 17481 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:34611 (error 108)
I20260806 00:54:01.956081 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 17774
I20260806 00:54:01.963039 18158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:01.962884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:34611 (local address 127.0.0.1:52710)
0806 00:54:01.962942 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:01.962992 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:34611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 00:54:01.963506 17481 catalog_manager.cc:4584] TS 06a76bee1cad4293b69ad9e89e0640ce (127.3.98.129:34611): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 818e4395df4f4a13bb90ca9816d66e26: Network error: Client connection negotiation failed: client connection to 127.3.98.129:34611: connect: Connection refused (error 111)
I20260806 00:54:01.967586 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 17963
I20260806 00:54:01.978223 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 17462
2026-08-06T00:54:01Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2338 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:54:02 dist-test-slave-44d2 krb5kdc[18202](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:54:02 dist-test-slave-44d2 krb5kdc[18202](info): set up 2 sockets
Aug 06 00:54:02 dist-test-slave-44d2 krb5kdc[18202](info): commencing operation
krb5kdc: starting...
W20260806 00:54:03.296007 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:54:03 dist-test-slave-44d2 krb5kdc[18202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977643, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:54:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:54:03Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.3.98.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.3.98.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/rangeradmin_127.3.98.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/rangeradmin_127.3.98.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.3.98.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.3.98.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/rangerlookup_127.3.98.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/rangerlookup_127.3.98.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.3.98.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.3.98.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/HTTP_127.3.98.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/HTTP_127.3.98.148@KRBTEST.COM.keytab.
I20260806 00:54:03.475809 3466 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasksA1zh9/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/postgres -l logfile start
2026-08-06 00:54:06.229 UTC [18235] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 00:54:06.229 UTC [18235] LOG: listening on IPv4 address "127.3.98.148", port 60033
2026-08-06 00:54:06.234 UTC [18235] LOG: listening on Unix socket "/tmp/.s.PGSQL.60033"
2026-08-06 00:54:06.258 UTC [18239] LOG: database system was shut down at 2026-08-06 00:54:04 UTC
2026-08-06 00:54:06.262 UTC [18235] LOG: database system is ready to accept connections
I20260806 00:54:07.394352 3466 mini_postgres.cc:96] Postgres bound to 60033
2026-08-06 00:54:07.403 UTC [18251] FATAL: database "slave" does not exist
127.3.98.148:60033 - accepting connections
I20260806 00:54:07.404040 3466 mini_ranger.cc:161] Starting Ranger...
I20260806 00:54:07.420626 3466 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 00:54:07.969209 3466 mini_ranger.cc:87] Created ranger Postgres database
I20260806 00:54:07.969287 3466 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-admin
2026-08-06 00:54:08,349 [I] DB FLAVOR :POSTGRES
2026-08-06 00:54:08,350 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 00:54:08,350 [I] Checking connection..
2026-08-06 00:54:08,350 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 00:54:08,634 [I] Checking connection passed.
2026-08-06 00:54:08,634 [I] --------- Verifying version history table ---------
2026-08-06 00:54:08,634 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 00:54:08,899 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 00:54:08,900 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 00:54:09,180 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 00:54:09,181 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 00:54:09,181 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 00:54:09.443 UTC [18348] WARNING: there is no transaction in progress
2026-08-06 00:54:09,451 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 00:54:09,452 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 00:54:09,722 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 00:54:09,723 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 00:54:09,723 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 00:54:09,966 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 00:54:10,212 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-44d2.c.gcp-upstream.internal','N') ;"
2026-08-06 00:54:10,450 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 00:54:10,704 [I] Table x_portal_user does not exist in database ranger
2026-08-06 00:54:10,704 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 00:54:10,976 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 00:54:10,976 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 00:54:11,224 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 00:54:11,490 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 00:54:11,490 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 00:54:12.477 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.493 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.510 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.526 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.545 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.563 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.622 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.629 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.644 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.657 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.668 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.683 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.693 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.700 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.710 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:12.717 UTC [18491] WARNING: there is no transaction in progress
2026-08-06 00:54:13,407 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 00:54:13,407 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 00:54:13,656 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 00:54:13,656 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 00:54:13,895 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 00:54:13,895 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 00:54:14,180 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 00:54:14,180 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 00:54:14,440 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 00:54:14,724 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-44d2.c.gcp-upstream.internal';"
2026-08-06 00:54:14,980 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 00:54:14,981 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 00:54:15,260 [I] DB_PATCHES have already been applied
I20260806 00:54:15.266004 3466 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-admin:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasksA1zh9/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 00:54:15.266083 3466 mini_ranger.cc:193] Using host: 127.3.98.148
I20260806 00:54:15.270546 3466 mini_ranger.cc:227] Ranger admin URL: http://127.3.98.148:45121
Aug 06, 2026 12:54:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 12:54:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 12:54:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 12:54:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 12:54:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 12:54:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 12:54:16 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 00:54:16.587103 3466 mini_ranger.cc:160] Time spent starting Ranger: real 9.183s user 0.000s sys 0.012s
Aug 06, 2026 12:54:36 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 12:54:36 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 06, 2026 12:54:36 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 12:54:36 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 12:54:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 12:54:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 12:54:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 12:54:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 12:54:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 12:54:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 12:54:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 12:54:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 12:54:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 12:54:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 12:54:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 12:54:36 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 12:54:36 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 12:54:37 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 00:54:38.245765 3466 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.3.98.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.3.98.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/rangerkms_127.3.98.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/rangerkms_127.3.98.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.3.98.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.3.98.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.3.98.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/HTTP_127.3.98.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.3.98.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/HTTP_127.3.98.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 00:54:38 dist-test-slave-44d2 krb5kdc[18202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977678, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 00:54:38.347275 3466 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 00:54:38.358724 3466 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 00:54:39.213685 3466 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 00:54:39.213784 3466 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-kms
I20260806 00:54:39.213802 3466 mini_ranger_kms.cc:227] Using postgres at 127.3.98.148:60033
2026-08-06 00:54:39,935 [I] DB FLAVOR :POSTGRES
2026-08-06 00:54:39,936 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 00:54:39,936 [I] Checking connection
2026-08-06 00:54:39,936 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 00:54:40,190 [I] connection success
2026-08-06 00:54:40,191 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 00:54:40,191 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 00:54:40,191 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 00:54:40,429 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 00:54:40,430 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 00:54:40,430 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 00:54:40,430 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:60033/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 00:54:40,710 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 00:54:41.192471 3466 mini_ranger_kms.cc:310] Created kms service
I20260806 00:54:41.408690 3466 mini_ranger_kms.cc:326] Created kudu user
I20260806 00:54:41.457718 3466 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 00:54:41 dist-test-slave-44d2 krb5kdc[18202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977678, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:54:41.874766 3466 mini_ranger_kms.cc:384] Added ranger policy
I20260806 00:54:41.874890 3466 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-kms:/tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 00:54:41.874912 3466 mini_ranger_kms.cc:240] Using host: 127.3.98.148
I20260806 00:54:41.879391 3466 mini_ranger_kms.cc:276] Ranger KMS PID: 18743
I20260806 00:54:41.879520 3466 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.3.98.148:41285
Aug 06, 2026 12:54:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 12:54:42 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 12:54:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 12:54:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 12:54:43 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 12:54:43 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 00:54:44 dist-test-slave-44d2 krb5kdc[18202](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785977684, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.98.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:54:44.687716 3466 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.340s user 0.030s sys 0.229s
I20260806 00:54:44.687829 3466 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 00:54:44.687945 3466 mini_ranger_kms.cc:401] 127.3.98.148:41285/kms/v1/keys
Aug 06 00:54:44 dist-test-slave-44d2 krb5kdc[18202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977684, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.98.148@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
Aug 06 00:54:45 dist-test-slave-44d2 krb5kdc[18202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977684, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.98.148@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
Aug 06 00:54:47 dist-test-slave-44d2 krb5kdc[18202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:54:47.420030 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:42461
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:36037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:42461
--ranger_config_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.98.148:41285/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:54:47.509078 18822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:54:47.509272 18822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:54:47.509294 18822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:54:47.510426 18822 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:54:47.510469 18822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:54:47.510483 18822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:54:47.510535 18822 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:54:47.510552 18822 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:54:47.512192 18822 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/wal
--ranger_kms_url=127.3.98.148:41285/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:42461
--ranger_config_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:42461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:54:47.512456 18822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:54:47.512734 18822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:54:47.517704 18829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:47.517733 18836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:47.517733 18828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:54:47.517920 18822 server_base.cc:1034] running on GCE node
I20260806 00:54:47.518195 18822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:54:47.518481 18822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:54:47.519654 18822 hybrid_clock.cc:648] HybridClock initialized: now 1785977687519636 us; error 44 us; skew 500 ppm
Aug 06 00:54:47 dist-test-slave-44d2 krb5kdc[18202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977687, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:54:47.522174 18822 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:54:47.522622 18822 webserver.cc:460] Webserver started at http://127.3.98.190:40971/ using document root <none> and password file <none>
I20260806 00:54:47.522862 18822 fs_manager.cc:359] Metadata directory not provided
I20260806 00:54:47.522925 18822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:54:47.523089 18822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 00:54:47 dist-test-slave-44d2 krb5kdc[18202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977687, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:54:47.571465 18822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "0fa7db4efc884258b18eafd653d38e3b"
format_stamp: "Formatted at 2026-08-06 00:54:47 on dist-test-slave-44d2"
server_key: "b5190428f2c7dff9cad2a5450555512e"
server_key_iv: "985a70f9654dfaf78065cbf7c3994a8a"
server_key_version: "kuduclusterkey@0"
I20260806 00:54:47.571998 18822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "0fa7db4efc884258b18eafd653d38e3b"
format_stamp: "Formatted at 2026-08-06 00:54:47 on dist-test-slave-44d2"
server_key: "b5190428f2c7dff9cad2a5450555512e"
server_key_iv: "985a70f9654dfaf78065cbf7c3994a8a"
server_key_version: "kuduclusterkey@0"
I20260806 00:54:47.574028 18822 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260806 00:54:47.586333 18849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:47.586555 18822 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 00:54:47.586668 18822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "0fa7db4efc884258b18eafd653d38e3b"
format_stamp: "Formatted at 2026-08-06 00:54:47 on dist-test-slave-44d2"
server_key: "b5190428f2c7dff9cad2a5450555512e"
server_key_iv: "985a70f9654dfaf78065cbf7c3994a8a"
server_key_version: "kuduclusterkey@0"
I20260806 00:54:47.586797 18822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:54:47.600730 18822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:54:47.602905 18822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:54:47.603085 18822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:54:47.608372 18822 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:42461
I20260806 00:54:47.608451 18919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:42461 every 8 connection(s)
I20260806 00:54:47.608853 18822 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:54:47.609710 18921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:54:47.611994 18921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b: Bootstrap starting.
I20260806 00:54:47.612689 18921 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b: Neither blocks nor log segments found. Creating new log.
I20260806 00:54:47.612943 18921 log.cc:824] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b: Log is configured to *not* fsync() on all Append() calls
I20260806 00:54:47.613689 18921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b: No bootstrap required, opened a new log
I20260806 00:54:47.615819 18921 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7db4efc884258b18eafd653d38e3b" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42461 } }
I20260806 00:54:47.615965 18921 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:54:47.615988 18921 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fa7db4efc884258b18eafd653d38e3b, State: Initialized, Role: FOLLOWER
I20260806 00:54:47.616089 18921 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7db4efc884258b18eafd653d38e3b" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42461 } }
I20260806 00:54:47.616142 18921 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:54:47.616161 18921 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:54:47.616241 18921 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:54:47.616572 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 18822
I20260806 00:54:47.616654 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:54:47.616851 3466 external_mini_cluster.cc:1428] Setting key 9f332e02d8edf5d3e0f88f6f2f7f7b04
I20260806 00:54:47.616957 18921 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7db4efc884258b18eafd653d38e3b" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42461 } }
I20260806 00:54:47.617095 18921 leader_election.cc:302] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fa7db4efc884258b18eafd653d38e3b; no voters:
I20260806 00:54:47.617292 18921 leader_election.cc:288] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:54:47.617340 18925 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:54:47.617547 18925 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [term 1 LEADER]: Becoming Leader. State: Replica: 0fa7db4efc884258b18eafd653d38e3b, State: Running, Role: LEADER
I20260806 00:54:47.617689 18925 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7db4efc884258b18eafd653d38e3b" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42461 } }
I20260806 00:54:47.617697 18921 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:54:47.619333 18932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fa7db4efc884258b18eafd653d38e3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7db4efc884258b18eafd653d38e3b" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42461 } } }
I20260806 00:54:47.619442 18932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [sys.catalog]: This master's current role is: LEADER
I20260806 00:54:47.619688 18948 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:54:47.619740 18931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fa7db4efc884258b18eafd653d38e3b. Latest consensus state: current_term: 1 leader_uuid: "0fa7db4efc884258b18eafd653d38e3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fa7db4efc884258b18eafd653d38e3b" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 42461 } } }
I20260806 00:54:47.619867 18921 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 00:54:47.619902 18931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b [sys.catalog]: This master's current role is: LEADER
I20260806 00:54:47.620204 18948 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:54:47.624806 18948 catalog_manager.cc:1347] Generated new cluster ID: 67074a2eb72942f198a65237e0ab35b5
I20260806 00:54:47.625041 18948 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:54:47 dist-test-slave-44d2 krb5kdc[18202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977687, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:54:47.635994 18929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:47.617377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45228 (local address 127.3.98.190:42461)
0806 00:54:47.617583 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:47.617595 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:47.617670 (+ 75us) server_negotiation.cc:407] Connection header received
0806 00:54:47.617857 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:47.617865 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:47.617926 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:47.618072 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:54:47.618973 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:47.620447 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:47.621705 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:47.625056 (+ 3351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:47.625257 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:47.631684 (+ 6427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:54:47.631688 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:54:47.631689 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:54:47.631701 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:54:47.633792 (+ 2091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:47.634201 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:47.634204 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:47.634205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:47.634303 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:47.634525 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:47.634526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:47.634526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:47.634838 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:54:47.634987 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:47.635525 (+ 538us) server_negotiation.cc:299] Negotiation successful
0806 00:54:47.635655 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":72,"threads_started":1}
I20260806 00:54:47.664024 18948 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:54:47.664904 18948 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:54:47.671787 18948 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b: Generated new TSK 0
I20260806 00:54:47.671989 18948 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:54:48.360167 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.98.148:41285/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42461
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:36037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:54:48.487047 18987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:54:48.487331 18987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:54:48.487375 18987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:54:48.489068 18987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:54:48.489131 18987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:54:48.489171 18987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:54:48.491307 18987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.3.98.148:41285/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:54:48.491562 18987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:54:48.491858 18987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:54:48.497542 19001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:48.497884 18997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:54:48.498437 18987 server_base.cc:1034] running on GCE node
W20260806 00:54:48.498981 18994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:54:48.499221 18987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:54:48.499537 18987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:54:48.500720 18987 hybrid_clock.cc:648] HybridClock initialized: now 1785977688500698 us; error 56 us; skew 500 ppm
Aug 06 00:54:48 dist-test-slave-44d2 krb5kdc[18202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977688, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:54:48.504109 18987 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:54:48.504710 18987 webserver.cc:460] Webserver started at http://127.3.98.129:46355/ using document root <none> and password file <none>
I20260806 00:54:48.504998 18987 fs_manager.cc:359] Metadata directory not provided
I20260806 00:54:48.505065 18987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:54:48.505190 18987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 00:54:48 dist-test-slave-44d2 krb5kdc[18202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977688, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:54:48.521162 18987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "5e3614fc8fd941a78fc97ff1c307a981"
format_stamp: "Formatted at 2026-08-06 00:54:48 on dist-test-slave-44d2"
server_key: "53257ec6481aaa50ab4348c6299d154d"
server_key_iv: "19c4753559deda1f08995f4300b29d46"
server_key_version: "kuduclusterkey@0"
I20260806 00:54:48.521678 18987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "5e3614fc8fd941a78fc97ff1c307a981"
format_stamp: "Formatted at 2026-08-06 00:54:48 on dist-test-slave-44d2"
server_key: "53257ec6481aaa50ab4348c6299d154d"
server_key_iv: "19c4753559deda1f08995f4300b29d46"
server_key_version: "kuduclusterkey@0"
I20260806 00:54:48.523684 18987 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 00:54:48.539345 19013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:48.539606 18987 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:54:48.539745 18987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "5e3614fc8fd941a78fc97ff1c307a981"
format_stamp: "Formatted at 2026-08-06 00:54:48 on dist-test-slave-44d2"
server_key: "53257ec6481aaa50ab4348c6299d154d"
server_key_iv: "19c4753559deda1f08995f4300b29d46"
server_key_version: "kuduclusterkey@0"
I20260806 00:54:48.539844 18987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:54:48.558045 18987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:54:48.560614 18987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:54:48.560783 18987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:54:48.561077 18987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:54:48.561502 18987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:54:48.561559 18987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:48.561628 18987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:54:48.561673 18987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:48.569715 18987 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:36591
I20260806 00:54:48.569778 19189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:36591 every 8 connection(s)
I20260806 00:54:48.570178 18987 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:54:48.576002 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 18987
I20260806 00:54:48.576120 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:54:48.576339 3466 external_mini_cluster.cc:1428] Setting key 790f54ec6230807a816962ec03b73f67
Aug 06 00:54:48 dist-test-slave-44d2 krb5kdc[18202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977688, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:54:48.582556 19193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:48.571128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:42461 (local address 127.3.98.129:50173)
0806 00:54:48.571310 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:48.571353 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:48.571884 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:48.572261 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:48.572265 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:48.572471 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:54:48.572784 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:48.572790 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:48.573520 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:48.573521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:48.574336 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:48.574338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:48.574752 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:48.574753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:48.574884 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:48.575457 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:54:48.575465 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:54:48.577051 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:54:48.580922 (+ 3871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:54:48.580929 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:54:48.580931 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:54:48.581216 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:54:48.581445 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:54:48.581446 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:54:48.581446 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:54:48.581559 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:54:48.581838 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:54:48.581846 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:54:48.582077 (+ 231us) client_negotiation.cc:769] Sending connection context
0806 00:54:48.582206 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 00:54:48.582352 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":104,"threads_started":1}
I20260806 00:54:48.583132 19195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:48.571394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:50173 (local address 127.3.98.190:42461)
0806 00:54:48.572042 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:48.572044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:48.572050 (+ 6us) server_negotiation.cc:407] Connection header received
0806 00:54:48.572074 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:48.572075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:48.572085 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:48.572179 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:54:48.572885 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:48.573414 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:48.574434 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:48.574651 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:48.574739 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:48.578940 (+ 4201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:54:48.578942 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:54:48.578943 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:54:48.578952 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:54:48.580820 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:48.581303 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:48.581305 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:48.581305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:48.581372 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:48.581629 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:48.581631 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:48.581631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:48.581774 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:54:48.581837 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:48.582861 (+ 1024us) server_negotiation.cc:299] Negotiation successful
0806 00:54:48.582971 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":83,"threads_started":1}
I20260806 00:54:48.583873 19190 heartbeater.cc:347] Connected to a master server at 127.3.98.190:42461
I20260806 00:54:48.583990 19190 heartbeater.cc:464] Registering TS with master...
I20260806 00:54:48.584213 19190 heartbeater.cc:511] Master 127.3.98.190:42461 requested a full tablet report, sending...
I20260806 00:54:48.584842 18871 ts_manager.cc:194] Registered new tserver with Master: 5e3614fc8fd941a78fc97ff1c307a981 (127.3.98.129:36591)
I20260806 00:54:48.585767 18871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:50173
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:54:48.609238 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.98.148:41285/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42461
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:36037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:54:48.737363 19199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:54:48.737632 19199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:54:48.737675 19199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:54:48.739495 19199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:54:48.739557 19199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:54:48.739598 19199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:54:48.741845 19199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.3.98.148:41285/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:54:48.742129 19199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:54:48.742450 19199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:54:48.749316 19211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:48.749568 19213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:48.749719 19208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:54:48.750262 19199 server_base.cc:1034] running on GCE node
I20260806 00:54:48.750516 19199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:54:48.750790 19199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:54:48.751958 19199 hybrid_clock.cc:648] HybridClock initialized: now 1785977688751937 us; error 36 us; skew 500 ppm
Aug 06 00:54:48 dist-test-slave-44d2 krb5kdc[18202](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785977688, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 00:54:48 dist-test-slave-44d2 krb5kdc[18202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977688, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:54:48.755215 19199 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:54:48.755770 19199 webserver.cc:460] Webserver started at http://127.3.98.130:35855/ using document root <none> and password file <none>
I20260806 00:54:48.756060 19199 fs_manager.cc:359] Metadata directory not provided
I20260806 00:54:48.756155 19199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:54:48.756445 19199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 00:54:48 dist-test-slave-44d2 krb5kdc[18202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977688, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:54:48.788969 19199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "d35f21f3c6404a199e1f11ee43bdc087"
format_stamp: "Formatted at 2026-08-06 00:54:48 on dist-test-slave-44d2"
server_key: "ba06217eb2478fe74a2ca8218348680e"
server_key_iv: "c2c2c834eba463ef3794051da8162966"
server_key_version: "kuduclusterkey@0"
I20260806 00:54:48.789508 19199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "d35f21f3c6404a199e1f11ee43bdc087"
format_stamp: "Formatted at 2026-08-06 00:54:48 on dist-test-slave-44d2"
server_key: "ba06217eb2478fe74a2ca8218348680e"
server_key_iv: "c2c2c834eba463ef3794051da8162966"
server_key_version: "kuduclusterkey@0"
I20260806 00:54:48.791699 19199 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260806 00:54:48.812678 19220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:48.812983 19199 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260806 00:54:48.813094 19199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "d35f21f3c6404a199e1f11ee43bdc087"
format_stamp: "Formatted at 2026-08-06 00:54:48 on dist-test-slave-44d2"
server_key: "ba06217eb2478fe74a2ca8218348680e"
server_key_iv: "c2c2c834eba463ef3794051da8162966"
server_key_version: "kuduclusterkey@0"
I20260806 00:54:48.813195 19199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:54:48.836777 19199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:54:48.839367 19199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:54:48.839569 19199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:54:48.839840 19199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:54:48.840245 19199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:54:48.840317 19199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:48.840417 19199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:54:48.840461 19199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:48.848323 19199 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:46111
I20260806 00:54:48.848433 19384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:46111 every 8 connection(s)
I20260806 00:54:48.848899 19199 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:54:48.852931 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 19199
I20260806 00:54:48.853034 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:54:48.853230 3466 external_mini_cluster.cc:1428] Setting key 902c0b54986da5cd6006820ba9624224
Aug 06 00:54:48 dist-test-slave-44d2 krb5kdc[18202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977688, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:54:48.860708 19388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:48.849683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:42461 (local address 127.3.98.130:41409)
0806 00:54:48.849848 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:48.849898 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:48.850542 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:48.850816 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:48.850820 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:48.851089 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:54:48.851395 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:48.851402 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:48.852459 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:48.852461 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:48.854070 (+ 1609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:48.854074 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:48.854664 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:48.854665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:48.854812 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:48.855398 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:54:48.855409 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:54:48.857103 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:54:48.859068 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:54:48.859075 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:54:48.859077 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:54:48.859371 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:54:48.859585 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:54:48.859586 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:54:48.859586 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:54:48.859710 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:54:48.860004 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:54:48.860010 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:54:48.860170 (+ 160us) client_negotiation.cc:769] Sending connection context
0806 00:54:48.860276 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 00:54:48.860436 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
I20260806 00:54:48.861415 19195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:48.849695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:41409 (local address 127.3.98.190:42461)
0806 00:54:48.849745 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:48.849747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:48.850014 (+ 267us) server_negotiation.cc:407] Connection header received
0806 00:54:48.850653 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:48.850654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:48.850667 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:48.850733 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:54:48.851513 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:48.852340 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:48.854178 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:48.854512 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:48.854564 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:48.857211 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:54:48.857213 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:54:48.857213 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:54:48.857222 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:54:48.858971 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:48.859458 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:48.859459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:48.859460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:48.859518 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:48.859775 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:48.859776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:48.859776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:48.859917 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:54:48.859977 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:48.861228 (+ 1251us) server_negotiation.cc:299] Negotiation successful
0806 00:54:48.861323 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 00:54:48.861791 19385 heartbeater.cc:347] Connected to a master server at 127.3.98.190:42461
I20260806 00:54:48.862046 19385 heartbeater.cc:464] Registering TS with master...
I20260806 00:54:48.862293 19385 heartbeater.cc:511] Master 127.3.98.190:42461 requested a full tablet report, sending...
I20260806 00:54:48.862730 18871 ts_manager.cc:194] Registered new tserver with Master: d35f21f3c6404a199e1f11ee43bdc087 (127.3.98.130:46111)
I20260806 00:54:48.863220 18871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:41409
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:54:48.892270 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.98.148:41285/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42461
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:36037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:54:49.025151 19392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:54:49.025507 19392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:54:49.025557 19392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:54:49.027334 19392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:54:49.027410 19392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:54:49.027451 19392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:54:49.029691 19392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.3.98.148:41285/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:42461
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:54:49.029943 19392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:54:49.030267 19392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:54:49.037184 19399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:49.037305 19397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:54:49.037591 19401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:54:49.038722 19392 server_base.cc:1034] running on GCE node
I20260806 00:54:49.038955 19392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:54:49.039285 19392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:54:49.040539 19392 hybrid_clock.cc:648] HybridClock initialized: now 1785977689040492 us; error 35 us; skew 500 ppm
Aug 06 00:54:49 dist-test-slave-44d2 krb5kdc[18202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977689, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:54:49.043879 19392 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:54:49.044420 19392 webserver.cc:460] Webserver started at http://127.3.98.131:44173/ using document root <none> and password file <none>
I20260806 00:54:49.044696 19392 fs_manager.cc:359] Metadata directory not provided
I20260806 00:54:49.044771 19392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:54:49.044914 19392 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 00:54:49 dist-test-slave-44d2 krb5kdc[18202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977689, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:54:49.057689 19392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "bb9995aa9be4435fa46fc6b076fe4c97"
format_stamp: "Formatted at 2026-08-06 00:54:49 on dist-test-slave-44d2"
server_key: "16bbe0631f0ab02797af262761eb7395"
server_key_iv: "54b158ae2f4fd82b1869406d4ecac327"
server_key_version: "kuduclusterkey@0"
I20260806 00:54:49.058204 19392 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "bb9995aa9be4435fa46fc6b076fe4c97"
format_stamp: "Formatted at 2026-08-06 00:54:49 on dist-test-slave-44d2"
server_key: "16bbe0631f0ab02797af262761eb7395"
server_key_iv: "54b158ae2f4fd82b1869406d4ecac327"
server_key_version: "kuduclusterkey@0"
I20260806 00:54:49.060249 19392 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 00:54:49.092271 19409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:49.094291 19392 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.000s sys 0.000s
I20260806 00:54:49.094426 19392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "bb9995aa9be4435fa46fc6b076fe4c97"
format_stamp: "Formatted at 2026-08-06 00:54:49 on dist-test-slave-44d2"
server_key: "16bbe0631f0ab02797af262761eb7395"
server_key_iv: "54b158ae2f4fd82b1869406d4ecac327"
server_key_version: "kuduclusterkey@0"
I20260806 00:54:49.094540 19392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:54:49.126013 19392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:54:49.128881 19392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:54:49.129120 19392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:54:49.129565 19392 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:54:49.130084 19392 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:54:49.130141 19392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:49.130174 19392 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:54:49.130193 19392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:54:49.142424 19392 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:45097
I20260806 00:54:49.142936 19392 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:54:49.143373 19560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:45097 every 8 connection(s)
I20260806 00:54:49.151976 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 19392
I20260806 00:54:49.152117 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
Aug 06 00:54:49 dist-test-slave-44d2 krb5kdc[18202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977689, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:54:49.152359 3466 external_mini_cluster.cc:1428] Setting key 3c91ca4935209a0dbd850c0d4bc159bf
I20260806 00:54:49.156549 19195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.144212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:34647 (local address 127.3.98.190:42461)
0806 00:54:49.144263 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:49.144265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:49.144502 (+ 237us) server_negotiation.cc:407] Connection header received
0806 00:54:49.145463 (+ 961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:49.145464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:49.145479 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:49.145553 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:54:49.146493 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.147292 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.148921 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.149239 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.149305 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.152882 (+ 3577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:54:49.152885 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:54:49.152885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:54:49.152893 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:54:49.154764 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:49.155292 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:49.155293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:49.155294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:49.155421 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:49.155738 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:49.155739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:49.155739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:49.155876 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:54:49.155926 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:49.156319 (+ 393us) server_negotiation.cc:299] Negotiation successful
0806 00:54:49.156411 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 00:54:49.157477 19564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.143848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:42461 (local address 127.3.98.131:34647)
0806 00:54:49.144298 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:49.144365 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:49.145315 (+ 950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:49.145655 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:49.145660 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:49.146043 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:54:49.146369 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:49.146377 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.147412 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.147413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:49.148799 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:49.148803 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.149344 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.149346 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:49.149510 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.150879 (+ 1369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:54:49.150892 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:54:49.152775 (+ 1883us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:54:49.154858 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:54:49.154865 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:54:49.154868 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:54:49.155194 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:54:49.155510 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:54:49.155511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:54:49.155512 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:54:49.155651 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:54:49.155958 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:54:49.155964 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:54:49.156144 (+ 180us) client_negotiation.cc:769] Sending connection context
0806 00:54:49.157059 (+ 915us) client_negotiation.cc:240] Negotiation successful
0806 00:54:49.157246 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":119,"threads_started":1}
I20260806 00:54:49.157903 19562 heartbeater.cc:347] Connected to a master server at 127.3.98.190:42461
I20260806 00:54:49.157997 19562 heartbeater.cc:464] Registering TS with master...
I20260806 00:54:49.158200 19562 heartbeater.cc:511] Master 127.3.98.190:42461 requested a full tablet report, sending...
I20260806 00:54:49.158543 18871 ts_manager.cc:194] Registered new tserver with Master: bb9995aa9be4435fa46fc6b076fe4c97 (127.3.98.131:45097)
I20260806 00:54:49.159077 18871 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:34647
I20260806 00:54:49.164539 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:54:49.175946 19195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.166473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45232 (local address 127.3.98.190:42461)
0806 00:54:49.166549 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:49.166552 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:49.166842 (+ 290us) server_negotiation.cc:407] Connection header received
0806 00:54:49.166897 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:49.166898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:49.166912 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:49.166975 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:54:49.167703 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.168508 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.169611 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.169919 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.170019 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.171580 (+ 1561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:54:49.171582 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:54:49.171582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:54:49.171590 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:54:49.174707 (+ 3117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:49.175116 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:49.175118 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:49.175118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:49.175173 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:54:49.175363 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:54:49.175364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:54:49.175364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:54:49.175485 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:54:49.175558 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:49.175774 (+ 216us) server_negotiation.cc:299] Negotiation successful
0806 00:54:49.175851 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 00:54:49.178383 18871 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45232:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:54:49.180591 18871 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:54:49.189612 19576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.183437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:36591 (local address 127.0.0.1:37000)
0806 00:54:49.183671 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:49.183720 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:49.183806 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:49.185278 (+ 1472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:49.185279 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:49.185282 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:54:49.185350 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:49.185352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.186860 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.186861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:49.188085 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:49.188089 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.189216 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.189218 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:49.189312 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.189346 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 00:54:49.189413 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 00:54:49.189521 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":78,"threads_started":1}
I20260806 00:54:49.190084 19579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.184013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44782 (local address 127.3.98.130:46111)
0806 00:54:49.184408 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:49.184414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:49.184426 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:54:49.184502 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:49.184505 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:49.184525 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:49.184882 (+ 357us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:54:49.185104 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.186235 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.188054 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.189327 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.189412 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.189493 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:49.189953 (+ 460us) server_negotiation.cc:299] Negotiation successful
0806 00:54:49.189996 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":101,"threads_started":1}
I20260806 00:54:49.189847 19577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.183672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:46111 (local address 127.0.0.1:44782)
0806 00:54:49.184188 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:49.184200 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:49.184249 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:49.184900 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:49.184904 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:49.184906 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:54:49.184993 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:49.184995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.186586 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.186587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:49.187927 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:49.187930 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.189534 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.189535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:49.189604 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.189609 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:54:49.189694 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 00:54:49.189745 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"mutex_wait_us":34,"thread_start_us":65,"threads_started":1}
I20260806 00:54:49.191035 19578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.183884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37000 (local address 127.3.98.129:36591)
0806 00:54:49.185031 (+ 1147us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:49.185037 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:49.185049 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:54:49.185090 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:49.185092 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:49.185138 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:49.185462 (+ 324us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:54:49.185534 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.186728 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.188222 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.189085 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.190780 (+ 1695us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.190857 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:49.190889 (+ 32us) server_negotiation.cc:299] Negotiation successful
0806 00:54:49.190941 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1110,"thread_start_us":95,"threads_started":1}
I20260806 00:54:49.191254 19287 tablet_service.cc:1467] Processing CreateTablet for tablet 4d604888ff364186b9bebf823f837228 (DEFAULT_TABLE table=test-table [id=b192d7c752764be1bdbd6c4da569bbe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:54:49.191658 19287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d604888ff364186b9bebf823f837228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:54:49.191915 19087 tablet_service.cc:1467] Processing CreateTablet for tablet 4d604888ff364186b9bebf823f837228 (DEFAULT_TABLE table=test-table [id=b192d7c752764be1bdbd6c4da569bbe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:54:49.192278 19087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d604888ff364186b9bebf823f837228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:54:49.195756 19582 tablet_bootstrap.cc:492] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087: Bootstrap starting.
I20260806 00:54:49.196988 19582 tablet_bootstrap.cc:654] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087: Neither blocks nor log segments found. Creating new log.
I20260806 00:54:49.197359 19582 log.cc:824] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087: Log is configured to *not* fsync() on all Append() calls
I20260806 00:54:49.198145 19582 tablet_bootstrap.cc:492] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087: No bootstrap required, opened a new log
I20260806 00:54:49.198208 19582 ts_tablet_manager.cc:1397] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 00:54:49.200101 19582 raft_consensus.cc:348] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9995aa9be4435fa46fc6b076fe4c97" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45097 } } peers { permanent_uuid: "5e3614fc8fd941a78fc97ff1c307a981" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36591 } } peers { permanent_uuid: "d35f21f3c6404a199e1f11ee43bdc087" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 46111 } }
I20260806 00:54:49.200253 19582 raft_consensus.cc:374] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:54:49.200282 19582 raft_consensus.cc:729] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d35f21f3c6404a199e1f11ee43bdc087, State: Initialized, Role: FOLLOWER
I20260806 00:54:49.200392 19582 consensus_queue.cc:260] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9995aa9be4435fa46fc6b076fe4c97" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45097 } } peers { permanent_uuid: "5e3614fc8fd941a78fc97ff1c307a981" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36591 } } peers { permanent_uuid: "d35f21f3c6404a199e1f11ee43bdc087" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 46111 } }
I20260806 00:54:49.200645 19582 ts_tablet_manager.cc:1428] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 00:54:49.200907 19385 heartbeater.cc:503] Master 127.3.98.190:42461 was elected leader, sending a full tablet report...
I20260806 00:54:49.201143 19576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.184306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:45097 (local address 127.0.0.1:52012)
0806 00:54:49.190118 (+ 5812us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:49.190131 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:49.190271 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:49.196460 (+ 6189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:49.196461 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:49.196463 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:54:49.196536 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:49.196538 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.198059 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.198060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:49.199337 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:49.199340 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.200902 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.200904 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:49.200970 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.200976 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 00:54:49.201017 (+ 41us) client_negotiation.cc:240] Negotiation successful
0806 00:54:49.201061 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5797,"thread_start_us":71,"threads_started":1}
I20260806 00:54:49.202251 19581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.184596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52012 (local address 127.3.98.131:45097)
0806 00:54:49.196193 (+ 11597us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:49.196198 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:49.196213 (+ 15us) server_negotiation.cc:407] Connection header received
0806 00:54:49.196260 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:49.196262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:49.196282 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:49.196632 (+ 350us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:54:49.196724 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.197869 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.199486 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.200756 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.201991 (+ 1235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.202087 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:49.202118 (+ 31us) server_negotiation.cc:299] Negotiation successful
0806 00:54:49.202161 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11548,"thread_start_us":103,"threads_started":1}
I20260806 00:54:49.203162 19469 tablet_service.cc:1467] Processing CreateTablet for tablet 4d604888ff364186b9bebf823f837228 (DEFAULT_TABLE table=test-table [id=b192d7c752764be1bdbd6c4da569bbe3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:54:49.203565 19469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d604888ff364186b9bebf823f837228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:54:49.202641 19584 tablet_bootstrap.cc:492] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981: Bootstrap starting.
I20260806 00:54:49.205319 19584 tablet_bootstrap.cc:654] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981: Neither blocks nor log segments found. Creating new log.
I20260806 00:54:49.205981 19584 log.cc:824] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981: Log is configured to *not* fsync() on all Append() calls
I20260806 00:54:49.206763 19584 tablet_bootstrap.cc:492] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981: No bootstrap required, opened a new log
I20260806 00:54:49.206826 19584 ts_tablet_manager.cc:1397] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 00:54:49.207595 19588 tablet_bootstrap.cc:492] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97: Bootstrap starting.
I20260806 00:54:49.208786 19588 tablet_bootstrap.cc:654] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97: Neither blocks nor log segments found. Creating new log.
I20260806 00:54:49.209146 19588 log.cc:824] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97: Log is configured to *not* fsync() on all Append() calls
I20260806 00:54:49.209465 19584 raft_consensus.cc:348] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9995aa9be4435fa46fc6b076fe4c97" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45097 } } peers { permanent_uuid: "5e3614fc8fd941a78fc97ff1c307a981" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36591 } } peers { permanent_uuid: "d35f21f3c6404a199e1f11ee43bdc087" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 46111 } }
I20260806 00:54:49.209617 19584 raft_consensus.cc:374] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:54:49.209646 19584 raft_consensus.cc:729] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e3614fc8fd941a78fc97ff1c307a981, State: Initialized, Role: FOLLOWER
I20260806 00:54:49.209825 19584 consensus_queue.cc:260] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9995aa9be4435fa46fc6b076fe4c97" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45097 } } peers { permanent_uuid: "5e3614fc8fd941a78fc97ff1c307a981" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36591 } } peers { permanent_uuid: "d35f21f3c6404a199e1f11ee43bdc087" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 46111 } }
I20260806 00:54:49.209960 19588 tablet_bootstrap.cc:492] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97: No bootstrap required, opened a new log
I20260806 00:54:49.210043 19588 ts_tablet_manager.cc:1397] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 00:54:49.210093 19584 ts_tablet_manager.cc:1428] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:54:49.212608 19190 heartbeater.cc:503] Master 127.3.98.190:42461 was elected leader, sending a full tablet report...
I20260806 00:54:49.212371 19588 raft_consensus.cc:348] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9995aa9be4435fa46fc6b076fe4c97" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45097 } } peers { permanent_uuid: "5e3614fc8fd941a78fc97ff1c307a981" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36591 } } peers { permanent_uuid: "d35f21f3c6404a199e1f11ee43bdc087" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 46111 } }
I20260806 00:54:49.212815 19588 raft_consensus.cc:374] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:54:49.212877 19588 raft_consensus.cc:729] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb9995aa9be4435fa46fc6b076fe4c97, State: Initialized, Role: FOLLOWER
I20260806 00:54:49.213433 19588 consensus_queue.cc:260] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9995aa9be4435fa46fc6b076fe4c97" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45097 } } peers { permanent_uuid: "5e3614fc8fd941a78fc97ff1c307a981" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36591 } } peers { permanent_uuid: "d35f21f3c6404a199e1f11ee43bdc087" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 46111 } }
I20260806 00:54:49.213892 19562 heartbeater.cc:503] Master 127.3.98.190:42461 was elected leader, sending a full tablet report...
I20260806 00:54:49.213853 19588 ts_tablet_manager.cc:1428] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
Aug 06 00:54:49 dist-test-slave-44d2 krb5kdc[18202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977688, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
W20260806 00:54:49.321419 19192 tablet.cc:2369] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:54:49.322173 19586 raft_consensus.cc:482] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:54:49.322305 19586 raft_consensus.cc:504] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9995aa9be4435fa46fc6b076fe4c97" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45097 } } peers { permanent_uuid: "5e3614fc8fd941a78fc97ff1c307a981" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36591 } } peers { permanent_uuid: "d35f21f3c6404a199e1f11ee43bdc087" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 46111 } }
I20260806 00:54:49.322717 19586 leader_election.cc:288] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb9995aa9be4435fa46fc6b076fe4c97 (127.3.98.131:45097), 5e3614fc8fd941a78fc97ff1c307a981 (127.3.98.129:36591)
I20260806 00:54:49.326946 19388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.322900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:45097 (local address 127.3.98.130:53423)
0806 00:54:49.323012 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:49.323024 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:49.323069 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:49.323480 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:49.323482 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:49.323484 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:54:49.323560 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:49.323563 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.324687 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.324688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:49.325884 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:49.325888 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.326687 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.326688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:49.326773 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.326777 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:54:49.326824 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 00:54:49.326863 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91}
I20260806 00:54:49.327680 19581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.323162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:53423 (local address 127.3.98.131:45097)
0806 00:54:49.323269 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:49.323271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:49.323279 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:54:49.323309 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:49.323310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:49.323322 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:49.323374 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:54:49.323660 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.324432 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.325994 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.326571 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.326644 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.326654 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:49.327570 (+ 916us) server_negotiation.cc:299] Negotiation successful
0806 00:54:49.327615 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 00:54:49.327967 19487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d604888ff364186b9bebf823f837228" candidate_uuid: "d35f21f3c6404a199e1f11ee43bdc087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb9995aa9be4435fa46fc6b076fe4c97" is_pre_election: true
I20260806 00:54:49.328121 19487 raft_consensus.cc:2454] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d35f21f3c6404a199e1f11ee43bdc087 in term 0.
I20260806 00:54:49.328581 19226 leader_election.cc:302] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb9995aa9be4435fa46fc6b076fe4c97, d35f21f3c6404a199e1f11ee43bdc087; no voters:
I20260806 00:54:49.328718 19586 raft_consensus.cc:2781] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:54:49.328761 19586 raft_consensus.cc:482] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:54:49.328781 19586 raft_consensus.cc:3037] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:54:49.329766 19586 raft_consensus.cc:504] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9995aa9be4435fa46fc6b076fe4c97" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45097 } } peers { permanent_uuid: "5e3614fc8fd941a78fc97ff1c307a981" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36591 } } peers { permanent_uuid: "d35f21f3c6404a199e1f11ee43bdc087" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 46111 } }
I20260806 00:54:49.329911 19586 leader_election.cc:288] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [CANDIDATE]: Term 1 election: Requested vote from peers bb9995aa9be4435fa46fc6b076fe4c97 (127.3.98.131:45097), 5e3614fc8fd941a78fc97ff1c307a981 (127.3.98.129:36591)
I20260806 00:54:49.330265 19487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d604888ff364186b9bebf823f837228" candidate_uuid: "d35f21f3c6404a199e1f11ee43bdc087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb9995aa9be4435fa46fc6b076fe4c97"
I20260806 00:54:49.330363 19487 raft_consensus.cc:3037] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:54:49.331329 19487 raft_consensus.cc:2454] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d35f21f3c6404a199e1f11ee43bdc087 in term 1.
I20260806 00:54:49.331580 19226 leader_election.cc:302] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb9995aa9be4435fa46fc6b076fe4c97, d35f21f3c6404a199e1f11ee43bdc087; no voters:
I20260806 00:54:49.331707 19586 raft_consensus.cc:2781] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:54:49.331875 19586 raft_consensus.cc:686] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [term 1 LEADER]: Becoming Leader. State: Replica: d35f21f3c6404a199e1f11ee43bdc087, State: Running, Role: LEADER
I20260806 00:54:49.331981 19586 consensus_queue.cc:237] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9995aa9be4435fa46fc6b076fe4c97" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45097 } } peers { permanent_uuid: "5e3614fc8fd941a78fc97ff1c307a981" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36591 } } peers { permanent_uuid: "d35f21f3c6404a199e1f11ee43bdc087" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 46111 } }
I20260806 00:54:49.335557 18871 catalog_manager.cc:5495] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 reported cstate change: term changed from 0 to 1, leader changed from <none> to d35f21f3c6404a199e1f11ee43bdc087 (127.3.98.130). New cstate: current_term: 1 leader_uuid: "d35f21f3c6404a199e1f11ee43bdc087" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb9995aa9be4435fa46fc6b076fe4c97" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e3614fc8fd941a78fc97ff1c307a981" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d35f21f3c6404a199e1f11ee43bdc087" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 46111 } health_report { overall_health: HEALTHY } } }
I20260806 00:54:49.337214 19388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.322933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:36591 (local address 127.3.98.130:43067)
0806 00:54:49.327022 (+ 4089us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:49.327033 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:54:49.327072 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:54:49.333695 (+ 6623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:54:49.333697 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:54:49.333699 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:54:49.333734 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:49.333735 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.334693 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.334694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:49.335796 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:54:49.335798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.336998 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.336999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:54:49.337061 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.337065 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:54:49.337110 (+ 45us) client_negotiation.cc:240] Negotiation successful
0806 00:54:49.337145 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4078,"thread_start_us":89,"threads_started":1}
I20260806 00:54:49.337412 19578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.323221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:43067 (local address 127.3.98.129:36591)
0806 00:54:49.323433 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:49.323435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:49.327207 (+ 3772us) server_negotiation.cc:407] Connection header received
0806 00:54:49.327237 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:49.327239 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:49.327253 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:49.327298 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:54:49.333829 (+ 6531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.334589 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.335917 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.336879 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.336953 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.336964 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:49.337303 (+ 339us) server_negotiation.cc:299] Negotiation successful
0806 00:54:49.337349 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260806 00:54:49.338011 19106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d604888ff364186b9bebf823f837228" candidate_uuid: "d35f21f3c6404a199e1f11ee43bdc087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3614fc8fd941a78fc97ff1c307a981" is_pre_election: true
I20260806 00:54:49.338007 19104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d604888ff364186b9bebf823f837228" candidate_uuid: "d35f21f3c6404a199e1f11ee43bdc087" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e3614fc8fd941a78fc97ff1c307a981"
I20260806 00:54:49.338186 19106 raft_consensus.cc:2454] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d35f21f3c6404a199e1f11ee43bdc087 in term 0.
W20260806 00:54:49.350000 19387 tablet.cc:2369] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:54:49.377027 19579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.373728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44788 (local address 127.3.98.130:46111)
0806 00:54:49.373806 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 00:54:49.373808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:54:49.373817 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:54:49.373872 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:54:49.373873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:54:49.373900 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:54:49.373984 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:54:49.374161 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.374899 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.376016 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:54:49.376325 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:54:49.376408 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:54:49.376626 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:54:49.376768 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:54:49.376871 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 00:54:49.376897 (+ 26us) server_negotiation.cc:299] Negotiation successful
0806 00:54:49.376920 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 00:54:49.379050 19104 raft_consensus.cc:3037] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:54:49.380170 19104 raft_consensus.cc:1261] T 4d604888ff364186b9bebf823f837228 P 5e3614fc8fd941a78fc97ff1c307a981 [term 1 FOLLOWER]: Refusing update from remote peer d35f21f3c6404a199e1f11ee43bdc087: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:54:49.380641 19487 raft_consensus.cc:1261] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97 [term 1 FOLLOWER]: Refusing update from remote peer d35f21f3c6404a199e1f11ee43bdc087: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:54:49.380638 19594 consensus_queue.cc:1035] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e3614fc8fd941a78fc97ff1c307a981" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:54:49.381071 19594 consensus_queue.cc:1035] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb9995aa9be4435fa46fc6b076fe4c97" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:54:49.387320 19602 mvcc.cc:205] Tried to move back new op lower bound from 7315364615694000128 to 7315364615504449536. Current Snapshot: MvccSnapshot[applied={T|T < 7315364615694000128 or (T in {7315364615694000128})}]
I20260806 00:54:49.387645 18871 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:54:49.387741 18871 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45232:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:54:49.388566 18871 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0fa7db4efc884258b18eafd653d38e3b: Sending DeleteTablet for 3 replicas of tablet 4d604888ff364186b9bebf823f837228
I20260806 00:54:49.389010 19087 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d604888ff364186b9bebf823f837228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:54:49 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:37000
I20260806 00:54:49.389343 19287 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d604888ff364186b9bebf823f837228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:54:49 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:44782
I20260806 00:54:49.389711 19469 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d604888ff364186b9bebf823f837228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:54:49 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:52012
I20260806 00:54:49.390017 19611 tablet_replica.cc:330] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97: stopping tablet replica
I20260806 00:54:49.390152 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 18987
I20260806 00:54:49.390192 19611 raft_consensus.cc:2229] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:54:49.390312 19611 raft_consensus.cc:2258] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:54:49.399317 19610 tablet_replica.cc:330] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087: stopping tablet replica
I20260806 00:54:49.399573 19610 raft_consensus.cc:2229] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:54:49.399734 19610 raft_consensus.cc:2258] T 4d604888ff364186b9bebf823f837228 P d35f21f3c6404a199e1f11ee43bdc087 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260806 00:54:49.406738 18851 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:36591 (error 108)
I20260806 00:54:49.407473 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 19199
I20260806 00:54:49.410795 19611 ts_tablet_manager.cc:1905] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:54:49.412658 19611 ts_tablet_manager.cc:1918] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:54:49.412734 19611 log.cc:1196] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/4d604888ff364186b9bebf823f837228
I20260806 00:54:49.413404 19611 ts_tablet_manager.cc:1939] T 4d604888ff364186b9bebf823f837228 P bb9995aa9be4435fa46fc6b076fe4c97: Deleting consensus metadata
I20260806 00:54:49.414402 19576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.414265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:36591 (local address 127.0.0.1:37002)
0806 00:54:49.414320 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:49.414362 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:36591: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 00:54:49.414534 18854 catalog_manager.cc:4841] TS bb9995aa9be4435fa46fc6b076fe4c97 (127.3.98.131:45097): tablet 4d604888ff364186b9bebf823f837228 (table test-table [id=b192d7c752764be1bdbd6c4da569bbe3]) successfully deleted
W20260806 00:54:49.414686 18851 catalog_manager.cc:4584] TS 5e3614fc8fd941a78fc97ff1c307a981 (127.3.98.129:36591): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4d604888ff364186b9bebf823f837228: Network error: Client connection negotiation failed: client connection to 127.3.98.129:36591: connect: Connection refused (error 111)
I20260806 00:54:49.418648 19576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:54:49.418536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:46111 (local address 127.0.0.1:44798)
0806 00:54:49.418590 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0806 00:54:49.418616 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.130:46111: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260806 00:54:49.418757 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 19392
I20260806 00:54:49.429299 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 18822
I20260806 00:54:49.441385 3466 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 00:54:49.785871 3466 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 00:54:49.785969 3466 mini_ranger.cc:66] Stopping Ranger...
I20260806 00:54:50.131547 3466 mini_ranger.cc:68] Stopped Ranger
2026-08-06 00:54:50.131 UTC [18235] LOG: received smart shutdown request
2026-08-06 00:54:50.135 UTC [18235] LOG: background worker "logical replication launcher" (PID 18249) exited with exit code 1
2026-08-06 00:54:50.136 UTC [18241] LOG: shutting down
2026-08-06 00:54:50.312 UTC [18235] LOG: database system is shut down
2026-08-06T00:54:50Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48443 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:54:50 dist-test-slave-44d2 krb5kdc[19623](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:54:50 dist-test-slave-44d2 krb5kdc[19623](info): set up 2 sockets
Aug 06 00:54:50 dist-test-slave-44d2 krb5kdc[19623](info): commencing operation
krb5kdc: starting...
W20260806 00:54:51.654624 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:54:51 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977691, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:54:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:54:51Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.3.98.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.3.98.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/rangeradmin_127.3.98.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/rangeradmin_127.3.98.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.3.98.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.3.98.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/rangerlookup_127.3.98.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/rangerlookup_127.3.98.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.3.98.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.3.98.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/HTTP_127.3.98.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/HTTP_127.3.98.148@KRBTEST.COM.keytab.
I20260806 00:54:51.827118 3466 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasksA1zh9/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/postgres -l logfile start
2026-08-06 00:54:54.332 UTC [19664] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 00:54:54.333 UTC [19664] LOG: listening on IPv4 address "127.3.98.148", port 47421
2026-08-06 00:54:54.336 UTC [19664] LOG: listening on Unix socket "/tmp/.s.PGSQL.47421"
2026-08-06 00:54:54.358 UTC [19667] LOG: database system was shut down at 2026-08-06 00:54:52 UTC
2026-08-06 00:54:54.362 UTC [19664] LOG: database system is ready to accept connections
I20260806 00:54:55.510984 3466 mini_postgres.cc:96] Postgres bound to 47421
2026-08-06 00:54:55.518 UTC [19676] FATAL: database "slave" does not exist
127.3.98.148:47421 - accepting connections
I20260806 00:54:55.518745 3466 mini_ranger.cc:161] Starting Ranger...
I20260806 00:54:55.534529 3466 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 00:54:56.036787 3466 mini_ranger.cc:87] Created ranger Postgres database
I20260806 00:54:56.036883 3466 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-admin
2026-08-06 00:54:56,318 [I] DB FLAVOR :POSTGRES
2026-08-06 00:54:56,319 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 00:54:56,319 [I] Checking connection..
2026-08-06 00:54:56,319 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 00:54:56,587 [I] Checking connection passed.
2026-08-06 00:54:56,588 [I] --------- Verifying version history table ---------
2026-08-06 00:54:56,588 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 00:54:56,843 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 00:54:56,843 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 00:54:57,117 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 00:54:57,117 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 00:54:57,117 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 00:54:57.395 UTC [19764] WARNING: there is no transaction in progress
2026-08-06 00:54:57,403 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 00:54:57,404 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 00:54:57,676 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 00:54:57,676 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 00:54:57,676 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 00:54:57,935 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 00:54:58,217 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-44d2.c.gcp-upstream.internal','N') ;"
2026-08-06 00:54:58,468 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 00:54:58,727 [I] Table x_portal_user does not exist in database ranger
2026-08-06 00:54:58,727 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 00:54:58,976 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 00:54:58,976 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 00:54:59,251 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 00:54:59,507 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 00:54:59,507 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 00:55:00.451 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.468 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.485 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.501 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.521 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.544 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.611 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.617 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.633 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.643 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.654 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.668 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.678 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.684 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.691 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:00.698 UTC [19922] WARNING: there is no transaction in progress
2026-08-06 00:55:01,366 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 00:55:01,367 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 00:55:01,607 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 00:55:01,607 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 00:55:01,888 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 00:55:01,888 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 00:55:02,156 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 00:55:02,156 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 00:55:02,408 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 00:55:02,667 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-44d2.c.gcp-upstream.internal';"
2026-08-06 00:55:02,923 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 00:55:02,923 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 00:55:03,175 [I] DB_PATCHES have already been applied
I20260806 00:55:03.180977 3466 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-admin:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasksA1zh9/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 00:55:03.181051 3466 mini_ranger.cc:193] Using host: 127.3.98.148
I20260806 00:55:03.184916 3466 mini_ranger.cc:227] Ranger admin URL: http://127.3.98.148:41265
Aug 06, 2026 12:55:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 12:55:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 12:55:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 12:55:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 12:55:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 12:55:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 12:55:04 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 00:55:04.539299 3466 mini_ranger.cc:160] Time spent starting Ranger: real 9.021s user 0.003s sys 0.008s
Aug 06, 2026 12:55:23 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 12:55:24 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 06, 2026 12:55:24 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 12:55:24 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 12:55:24 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 00:55:25.570884 3466 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.3.98.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.3.98.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/rangerkms_127.3.98.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.3.98.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/rangerkms_127.3.98.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.3.98.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.3.98.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.3.98.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/HTTP_127.3.98.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.3.98.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/HTTP_127.3.98.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 00:55:25 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977725, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 00:55:25.672338 3466 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 00:55:25.683770 3466 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 00:55:26.582993 3466 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 00:55:26.583091 3466 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-kms
I20260806 00:55:26.583106 3466 mini_ranger_kms.cc:227] Using postgres at 127.3.98.148:47421
2026-08-06 00:55:26,765 [I] DB FLAVOR :POSTGRES
2026-08-06 00:55:26,765 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 00:55:26,765 [I] Checking connection
2026-08-06 00:55:26,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 00:55:27,013 [I] connection success
2026-08-06 00:55:27,014 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 00:55:27,014 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 00:55:27,014 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 00:55:27,301 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 00:55:27,301 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 00:55:27,301 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 00:55:27,301 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.98.148:47421/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 00:55:27,559 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 00:55:27.986308 3466 mini_ranger_kms.cc:310] Created kms service
I20260806 00:55:28.200426 3466 mini_ranger_kms.cc:326] Created kudu user
I20260806 00:55:28.243903 3466 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 00:55:28 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977725, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:55:28.648715 3466 mini_ranger_kms.cc:384] Added ranger policy
I20260806 00:55:28.648854 3466 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-kms:/tmp/dist-test-tasksA1zh9/build/release/bin/postgresql.jar:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasksA1zh9/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 00:55:28.648886 3466 mini_ranger_kms.cc:240] Using host: 127.3.98.148
I20260806 00:55:28.654486 3466 mini_ranger_kms.cc:276] Ranger KMS PID: 20165
I20260806 00:55:28.654579 3466 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.3.98.148:49519
Aug 06, 2026 12:55:29 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 12:55:29 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 12:55:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 12:55:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 12:55:30 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 12:55:30 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 06 00:55:30 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785977730, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.98.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:31.310199 3466 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.638s user 0.009s sys 0.157s
I20260806 00:55:31.310302 3466 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 00:55:31.310352 3466 mini_ranger_kms.cc:401] 127.3.98.148:49519/kms/v1/keys
Aug 06 00:55:31 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977730, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.98.148@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
Aug 06 00:55:31 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977730, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.98.148@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
Aug 06 00:55:34 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:55:34.287956 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:45547
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:44879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:45547
--ranger_config_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.98.148:49519/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:55:34.371181 20240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:34.371388 20240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:34.371409 20240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:34.372606 20240 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:55:34.372648 20240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:34.372663 20240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:34.372674 20240 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:55:34.372686 20240 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:55:34.374291 20240 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/wal
--ranger_kms_url=127.3.98.148:49519/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:45547
--ranger_config_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:45547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:34.374533 20240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:34.374779 20240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:34.380299 20246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:34.380505 20240 server_base.cc:1034] running on GCE node
W20260806 00:55:34.380317 20251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:34.380317 20247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:34.381065 20240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:34.381474 20240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:34.382668 20240 hybrid_clock.cc:648] HybridClock initialized: now 1785977734382639 us; error 42 us; skew 500 ppm
Aug 06 00:55:34 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977734, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:34.389024 20240 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:55:34.389541 20240 webserver.cc:460] Webserver started at http://127.3.98.190:40383/ using document root <none> and password file <none>
I20260806 00:55:34.389801 20240 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:34.389868 20240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:34.390071 20240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 00:55:34 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977734, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:55:34.438131 20240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "f584c344b1b44db7969f4860259b81b0"
format_stamp: "Formatted at 2026-08-06 00:55:34 on dist-test-slave-44d2"
server_key: "822eb7e135d11b973e0e22c2db3d13ad"
server_key_iv: "c28e4cbff755e26850a468fa4caab686"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:34.438539 20240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "f584c344b1b44db7969f4860259b81b0"
format_stamp: "Formatted at 2026-08-06 00:55:34 on dist-test-slave-44d2"
server_key: "822eb7e135d11b973e0e22c2db3d13ad"
server_key_iv: "c28e4cbff755e26850a468fa4caab686"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:34.440158 20240 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:55:34.452106 20260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:34.452324 20240 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:34.452431 20240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "f584c344b1b44db7969f4860259b81b0"
format_stamp: "Formatted at 2026-08-06 00:55:34 on dist-test-slave-44d2"
server_key: "822eb7e135d11b973e0e22c2db3d13ad"
server_key_iv: "c28e4cbff755e26850a468fa4caab686"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:34.452546 20240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:34.473652 20240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:34.475896 20240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:34.476079 20240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:34.481266 20240 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:45547
I20260806 00:55:34.481294 20321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:45547 every 8 connection(s)
I20260806 00:55:34.481720 20240 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:55:34.482559 20322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:34.484696 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 20240
I20260806 00:55:34.484859 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:55:34.485108 3466 external_mini_cluster.cc:1428] Setting key a8049dcb1ffb31bd142408e8f1173987
I20260806 00:55:34.485628 20322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0: Bootstrap starting.
I20260806 00:55:34.486373 20322 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:34.486703 20322 log.cc:824] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:34.487743 20322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0: No bootstrap required, opened a new log
I20260806 00:55:34.490427 20322 raft_consensus.cc:348] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f584c344b1b44db7969f4860259b81b0" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45547 } }
I20260806 00:55:34.490605 20322 raft_consensus.cc:374] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:34.490639 20322 raft_consensus.cc:729] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f584c344b1b44db7969f4860259b81b0, State: Initialized, Role: FOLLOWER
I20260806 00:55:34.490851 20322 consensus_queue.cc:260] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f584c344b1b44db7969f4860259b81b0" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45547 } }
I20260806 00:55:34.490937 20322 raft_consensus.cc:388] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:55:34.490971 20322 raft_consensus.cc:482] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:55:34.491011 20322 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:34.491724 20322 raft_consensus.cc:504] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f584c344b1b44db7969f4860259b81b0" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45547 } }
I20260806 00:55:34.491834 20322 leader_election.cc:302] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f584c344b1b44db7969f4860259b81b0; no voters:
I20260806 00:55:34.492031 20322 leader_election.cc:288] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:55:34.492108 20330 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:55:34.492357 20330 raft_consensus.cc:686] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 1 LEADER]: Becoming Leader. State: Replica: f584c344b1b44db7969f4860259b81b0, State: Running, Role: LEADER
I20260806 00:55:34.492388 20322 sys_catalog.cc:564] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:55:34.492564 20330 consensus_queue.cc:237] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f584c344b1b44db7969f4860259b81b0" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45547 } }
Aug 06 00:55:34 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:34.492957 20330 sys_catalog.cc:455] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f584c344b1b44db7969f4860259b81b0. Latest consensus state: current_term: 1 leader_uuid: "f584c344b1b44db7969f4860259b81b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f584c344b1b44db7969f4860259b81b0" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45547 } } }
I20260806 00:55:34.493040 20330 sys_catalog.cc:458] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:34.493943 20322 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 00:55:34.498476 20341 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:55:34.494349 20331 sys_catalog.cc:455] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f584c344b1b44db7969f4860259b81b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f584c344b1b44db7969f4860259b81b0" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45547 } } }
I20260806 00:55:34.499006 20331 sys_catalog.cc:458] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:34.500064 20341 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:55:34.501688 20325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:34.485715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44124 (local address 127.3.98.190:45547)
0806 00:55:34.485927 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:34.485938 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:34.485978 (+ 40us) server_negotiation.cc:407] Connection header received
0806 00:55:34.486527 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:34.486537 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:34.486611 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:34.486769 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:34.487655 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:34.488844 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:34.489710 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:34.490164 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:34.490309 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:34.493378 (+ 3069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:34.493385 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:34.493385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:34.493402 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:34.498672 (+ 5270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:34.499316 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:34.499324 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:34.499324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:34.499556 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:34.499855 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:34.499856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:34.499857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:34.500336 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:34.501094 (+ 758us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:34.501178 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 00:55:34.501355 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":80,"threads_started":1}
I20260806 00:55:34.502096 20341 catalog_manager.cc:1347] Generated new cluster ID: cbb374faf89044448e1ac1c4bf12cd87
I20260806 00:55:34.502141 20341 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:55:34.540627 20341 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:55:34.541591 20341 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:55:34.553699 20341 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0: Generated new TSK 0
I20260806 00:55:34.554046 20341 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:55:35.443601 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.98.148:49519/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:45547
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:44879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:55:35.583070 20386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:35.583381 20386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:35.583420 20386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:35.585346 20386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:35.585417 20386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:35.585472 20386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:55:35.587977 20386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.3.98.148:49519/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:45547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:35.588259 20386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:35.588666 20386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:35.594624 20402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:35.595006 20386 server_base.cc:1034] running on GCE node
W20260806 00:55:35.594640 20396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:35.594660 20395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:35.595762 20386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:35.596071 20386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:35.597261 20386 hybrid_clock.cc:648] HybridClock initialized: now 1785977735597246 us; error 35 us; skew 500 ppm
Aug 06 00:55:35 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977735, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:35.600106 20386 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:55:35.600669 20386 webserver.cc:460] Webserver started at http://127.3.98.129:43523/ using document root <none> and password file <none>
I20260806 00:55:35.600903 20386 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:35.600972 20386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:35.601126 20386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 00:55:35 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977735, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:55:35.614758 20386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "5aa2993c088b4f1997d8b93d37325865"
format_stamp: "Formatted at 2026-08-06 00:55:35 on dist-test-slave-44d2"
server_key: "2ed1fd7550bc06812dc9cd8957c543af"
server_key_iv: "21af37ac2c54dcbdbe3eb1ee2e272de0"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:35.615294 20386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "5aa2993c088b4f1997d8b93d37325865"
format_stamp: "Formatted at 2026-08-06 00:55:35 on dist-test-slave-44d2"
server_key: "2ed1fd7550bc06812dc9cd8957c543af"
server_key_iv: "21af37ac2c54dcbdbe3eb1ee2e272de0"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:35.617331 20386 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 00:55:35.635243 20412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:35.635550 20386 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260806 00:55:35.635679 20386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "5aa2993c088b4f1997d8b93d37325865"
format_stamp: "Formatted at 2026-08-06 00:55:35 on dist-test-slave-44d2"
server_key: "2ed1fd7550bc06812dc9cd8957c543af"
server_key_iv: "21af37ac2c54dcbdbe3eb1ee2e272de0"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:35.635793 20386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:35.674662 20386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:35.677627 20386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:35.677863 20386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:35.678161 20386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:35.678541 20386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:55:35.678592 20386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:35.678625 20386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:55:35.678645 20386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:35.686612 20386 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:41479
I20260806 00:55:35.686914 20568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:41479 every 8 connection(s)
I20260806 00:55:35.687201 20386 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:55:35.693197 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 20386
I20260806 00:55:35.693329 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:55:35.693542 3466 external_mini_cluster.cc:1428] Setting key 04fbd75f7a962cab07e3e7a37def6985
Aug 06 00:55:35 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977735, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:35.699671 20571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:35.688118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:33813 (local address 127.3.98.190:45547)
0806 00:55:35.688250 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:35.688252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:35.688820 (+ 568us) server_negotiation.cc:407] Connection header received
0806 00:55:35.689595 (+ 775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:35.689596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:35.689612 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:35.689661 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:35.690625 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:35.691598 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:35.692986 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:35.693248 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:35.693314 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:35.695866 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:35.695867 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:35.695868 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:35.695877 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:35.698030 (+ 2153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:35.698506 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:35.698507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:35.698508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:35.698597 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:35.698887 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:35.698888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:35.698888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:35.699026 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:35.699107 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:35.699467 (+ 360us) server_negotiation.cc:299] Negotiation successful
0806 00:55:35.699562 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":74,"threads_started":1}
I20260806 00:55:35.700050 20573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:35.688094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:45547 (local address 127.3.98.129:33813)
0806 00:55:35.688681 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:35.688724 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:35.689464 (+ 740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:35.689871 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:35.689874 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:35.690133 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:35.690480 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:35.690488 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:35.691702 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:35.691702 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:35.692877 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:35.692895 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:35.693352 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:35.693354 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:35.693530 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:35.694241 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:35.694253 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:35.695759 (+ 1506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:35.698137 (+ 2378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:35.698144 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:35.698146 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:35.698393 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:35.698675 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:35.698676 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:35.698676 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:35.698798 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:35.699110 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:35.699118 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:35.699298 (+ 180us) client_negotiation.cc:769] Sending connection context
0806 00:55:35.699426 (+ 128us) client_negotiation.cc:240] Negotiation successful
0806 00:55:35.699605 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":390,"threads_started":1}
I20260806 00:55:35.700656 20569 heartbeater.cc:347] Connected to a master server at 127.3.98.190:45547
I20260806 00:55:35.700767 20569 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:35.700978 20569 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
I20260806 00:55:35.701574 20279 ts_manager.cc:194] Registered new tserver with Master: 5aa2993c088b4f1997d8b93d37325865 (127.3.98.129:41479)
I20260806 00:55:35.702280 20279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:33813
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:55:35.731253 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.98.148:49519/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:45547
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:44879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 00:55:35 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785977735, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 00:55:35.856240 20576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:35.856561 20576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:35.856657 20576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:35.858302 20576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:35.858382 20576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:35.858425 20576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:55:35.860642 20576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.3.98.148:49519/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:45547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:35.860893 20576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:35.861225 20576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:35.867794 20590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:35.867866 20587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:35.868273 20576 server_base.cc:1034] running on GCE node
W20260806 00:55:35.868625 20588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:35.868891 20576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:35.869230 20576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:35.870468 20576 hybrid_clock.cc:648] HybridClock initialized: now 1785977735870445 us; error 36 us; skew 500 ppm
Aug 06 00:55:35 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977735, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:35.874063 20576 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:55:35.874729 20576 webserver.cc:460] Webserver started at http://127.3.98.130:44365/ using document root <none> and password file <none>
I20260806 00:55:35.875052 20576 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:35.875133 20576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:35.875284 20576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 00:55:35 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977735, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:55:35.900312 20576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "88fc9355a6104425b4794ba6b1b71751"
format_stamp: "Formatted at 2026-08-06 00:55:35 on dist-test-slave-44d2"
server_key: "137d81c574550956418f60aba28cfab1"
server_key_iv: "20145d897fc555e6da1aaaaf35afe551"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:35.900820 20576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "88fc9355a6104425b4794ba6b1b71751"
format_stamp: "Formatted at 2026-08-06 00:55:35 on dist-test-slave-44d2"
server_key: "137d81c574550956418f60aba28cfab1"
server_key_iv: "20145d897fc555e6da1aaaaf35afe551"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:35.902406 20576 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:35.915373 20598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:35.915617 20576 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:35.915729 20576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "88fc9355a6104425b4794ba6b1b71751"
format_stamp: "Formatted at 2026-08-06 00:55:35 on dist-test-slave-44d2"
server_key: "137d81c574550956418f60aba28cfab1"
server_key_iv: "20145d897fc555e6da1aaaaf35afe551"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:35.915823 20576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:35.936470 20576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:35.938731 20576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:35.938922 20576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:35.939230 20576 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:35.939674 20576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:55:35.939733 20576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:35.939769 20576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:55:35.939814 20576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:35.947216 20576 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:37425
I20260806 00:55:35.947621 20576 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:55:35.948596 20760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:37425 every 8 connection(s)
I20260806 00:55:35.949663 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 20576
I20260806 00:55:35.949800 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:55:35.950021 3466 external_mini_cluster.cc:1428] Setting key 3957abef5e7f237c6ba54a8188a6d09b
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Aug 06 00:55:35 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977735, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:35.971168 20571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:35.948602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:58033 (local address 127.3.98.190:45547)
0806 00:55:35.948660 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:35.948663 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:35.956098 (+ 7435us) server_negotiation.cc:407] Connection header received
0806 00:55:35.956879 (+ 781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:35.956882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:35.956901 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:35.956986 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:35.957859 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:35.958686 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:35.960345 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:35.960806 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:35.960860 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:35.967545 (+ 6685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:35.967547 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:35.967547 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:35.967557 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:35.969538 (+ 1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:35.970060 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:35.970061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:35.970062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:35.970133 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:35.970437 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:35.970438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:35.970438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:35.970574 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:35.970662 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:35.970966 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 00:55:35.971065 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 00:55:35.971385 20763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:35.948600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:45547 (local address 127.3.98.130:58033)
0806 00:55:35.955922 (+ 7322us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:35.955983 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:35.956742 (+ 759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:35.957151 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:35.957157 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:35.957432 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:35.957730 (+ 298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:35.957737 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:35.958813 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:35.958814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:35.960237 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:35.960240 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:35.960990 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:35.960991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:35.961138 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:35.961926 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:35.961938 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:35.967414 (+ 5476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:35.969670 (+ 2256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:35.969679 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:35.969682 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:35.969955 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:35.970215 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:35.970216 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:35.970216 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:35.970362 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:35.970650 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:35.970658 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:35.970821 (+ 163us) client_negotiation.cc:769] Sending connection context
0806 00:55:35.970945 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 00:55:35.971113 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7260,"thread_start_us":108,"threads_started":1}
I20260806 00:55:35.972097 20761 heartbeater.cc:347] Connected to a master server at 127.3.98.190:45547
I20260806 00:55:35.972223 20761 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:35.972458 20761 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
I20260806 00:55:35.972996 20279 ts_manager.cc:194] Registered new tserver with Master: 88fc9355a6104425b4794ba6b1b71751 (127.3.98.130:37425)
I20260806 00:55:35.973492 20279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:58033
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:55:35.987818 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.98.148:49519/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:45547
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:44879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:55:36.083586 20770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:36.083822 20770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:36.083864 20770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:36.085126 20770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:36.085196 20770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:36.085240 20770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:55:36.086907 20770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.3.98.148:49519/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:45547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:36.087182 20770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:36.087455 20770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:36.092622 20780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:36.093393 20777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:36.093503 20776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:36.093801 20770 server_base.cc:1034] running on GCE node
I20260806 00:55:36.094205 20770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:36.094532 20770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:36.095750 20770 hybrid_clock.cc:648] HybridClock initialized: now 1785977736095726 us; error 38 us; skew 500 ppm
Aug 06 00:55:36 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977736, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:36.099401 20770 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:55:36.099958 20770 webserver.cc:460] Webserver started at http://127.3.98.131:46027/ using document root <none> and password file <none>
I20260806 00:55:36.100251 20770 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:36.100319 20770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:36.100457 20770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 00:55:36 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977736, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:55:36.114856 20770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "642f1efd725443cc917d18361abd9cf1"
format_stamp: "Formatted at 2026-08-06 00:55:36 on dist-test-slave-44d2"
server_key: "47fc8559b54b66a3b64c3e17a6ddfc57"
server_key_iv: "bed0302b2863ccb0573dc9421dd9a869"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:36.115341 20770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "642f1efd725443cc917d18361abd9cf1"
format_stamp: "Formatted at 2026-08-06 00:55:36 on dist-test-slave-44d2"
server_key: "47fc8559b54b66a3b64c3e17a6ddfc57"
server_key_iv: "bed0302b2863ccb0573dc9421dd9a869"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:36.117275 20770 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260806 00:55:36.133771 20790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:36.134004 20770 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 00:55:36.134117 20770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "642f1efd725443cc917d18361abd9cf1"
format_stamp: "Formatted at 2026-08-06 00:55:36 on dist-test-slave-44d2"
server_key: "47fc8559b54b66a3b64c3e17a6ddfc57"
server_key_iv: "bed0302b2863ccb0573dc9421dd9a869"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:36.134243 20770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:36.151603 20770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:36.154296 20770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:36.154536 20770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:36.154871 20770 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:36.155386 20770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:55:36.155483 20770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:36.155565 20770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:55:36.155629 20770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:36.166702 20770 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:40891
I20260806 00:55:36.167240 20770 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:55:36.168082 20955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:40891 every 8 connection(s)
I20260806 00:55:36.170845 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 20770
I20260806 00:55:36.170974 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:55:36.171157 3466 external_mini_cluster.cc:1428] Setting key 6dd6af739f614c899c66143d8cf7d67d
Aug 06 00:55:36 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977736, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:36.186105 20571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:36.169676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:41019 (local address 127.3.98.190:45547)
0806 00:55:36.169727 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:36.169729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:36.170190 (+ 461us) server_negotiation.cc:407] Connection header received
0806 00:55:36.170880 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:36.170882 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:36.170896 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:36.170980 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:36.176303 (+ 5323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:36.177114 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:36.178792 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:36.179104 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:36.179150 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:36.181931 (+ 2781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:36.181933 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:36.181933 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:36.181941 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:36.184436 (+ 2495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:36.184973 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:36.184975 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:36.184975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:36.185051 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:36.185331 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:36.185332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:36.185332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:36.185461 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:36.185504 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:36.185901 (+ 397us) server_negotiation.cc:299] Negotiation successful
0806 00:55:36.185995 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 00:55:36.186635 20959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:36.169666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:45547 (local address 127.3.98.131:41019)
0806 00:55:36.170047 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:36.170104 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:36.170759 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:36.175618 (+ 4859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:36.175623 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:36.175890 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:36.176187 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:36.176193 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:36.177242 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:36.177243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:36.178684 (+ 1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:36.178687 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:36.179266 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:36.179268 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:36.179409 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:36.180008 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:36.180018 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:36.181816 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:36.184559 (+ 2743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:36.184567 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:36.184570 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:36.184874 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:36.185127 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:36.185128 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:36.185128 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:36.185259 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:36.185553 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:36.185559 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:36.185731 (+ 172us) client_negotiation.cc:769] Sending connection context
0806 00:55:36.186218 (+ 487us) client_negotiation.cc:240] Negotiation successful
0806 00:55:36.186383 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":100,"threads_started":1}
I20260806 00:55:36.187237 20956 heartbeater.cc:347] Connected to a master server at 127.3.98.190:45547
I20260806 00:55:36.187363 20956 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:36.187561 20956 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
I20260806 00:55:36.187978 20279 ts_manager.cc:194] Registered new tserver with Master: 642f1efd725443cc917d18361abd9cf1 (127.3.98.131:40891)
I20260806 00:55:36.188351 20279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:41019
I20260806 00:55:36.194418 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:55:36.195186 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 20386
I20260806 00:55:36.225243 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 20576
I20260806 00:55:36.231485 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 20770
I20260806 00:55:36.241652 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 20240
I20260806 00:55:36.255587 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:45547
--webserver_interface=127.3.98.190
--webserver_port=40383
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:44879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:45547
--ranger_config_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.98.148:49519/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.3.98.148:49519/kms with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:55:36.341197 20960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:36.341398 20960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:36.341420 20960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:36.342489 20960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:55:36.342526 20960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:36.342540 20960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:36.342552 20960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:55:36.342564 20960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:55:36.344058 20960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.3.98.148:49519/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:45547
--ranger_config_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:45547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=40383
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:36.344242 20960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:36.344401 20960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:36.349282 20973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:36.349289 20968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:36.349463 20960 server_base.cc:1034] running on GCE node
W20260806 00:55:36.349550 20970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:36.349867 20960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:36.350112 20960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:36.351261 20960 hybrid_clock.cc:648] HybridClock initialized: now 1785977736351246 us; error 27 us; skew 500 ppm
Aug 06 00:55:36 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977736, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:36.354025 20960 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:55:36.354530 20960 webserver.cc:460] Webserver started at http://127.3.98.190:40383/ using document root <none> and password file <none>
I20260806 00:55:36.354749 20960 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:36.354803 20960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 00:55:36 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977736, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:55:36.434388 20960 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:36.435278 20982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:36.435489 20960 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:36.435598 20960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "f584c344b1b44db7969f4860259b81b0"
format_stamp: "Formatted at 2026-08-06 00:55:34 on dist-test-slave-44d2"
server_key: "822eb7e135d11b973e0e22c2db3d13ad"
server_key_iv: "c28e4cbff755e26850a468fa4caab686"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:36.436072 20960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:36.451782 20960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:36.454017 20960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:36.454191 20960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:36.458590 20960 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:45547
I20260806 00:55:36.458644 21055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:45547 every 8 connection(s)
I20260806 00:55:36.459013 20960 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:55:36.460227 21057 sys_catalog.cc:263] Verifying existing consensus state
I20260806 00:55:36.460950 21057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0: Bootstrap starting.
I20260806 00:55:36.462587 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 20960
I20260806 00:55:36.462895 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.98.148:49519/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:41479
--local_ip_for_outbound_sockets=127.3.98.129
--tserver_master_addrs=127.3.98.190:45547
--webserver_port=43523
--webserver_interface=127.3.98.129
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:44879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.3.98.148:49519/kms with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:55:36.469553 21057 log.cc:824] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:36.471335 21057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 00:55:36.471639 21057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0: Bootstrap complete.
I20260806 00:55:36.474129 21057 raft_consensus.cc:348] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f584c344b1b44db7969f4860259b81b0" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45547 } }
I20260806 00:55:36.474395 21057 raft_consensus.cc:729] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f584c344b1b44db7969f4860259b81b0, State: Initialized, Role: FOLLOWER
I20260806 00:55:36.474601 21057 consensus_queue.cc:260] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f584c344b1b44db7969f4860259b81b0" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45547 } }
I20260806 00:55:36.474700 21057 raft_consensus.cc:388] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:55:36.474754 21057 raft_consensus.cc:482] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:55:36.474804 21057 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 1 FOLLOWER]: Advancing to term 2
I20260806 00:55:36.475797 21057 raft_consensus.cc:504] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f584c344b1b44db7969f4860259b81b0" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45547 } }
I20260806 00:55:36.475919 21057 leader_election.cc:302] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f584c344b1b44db7969f4860259b81b0; no voters:
I20260806 00:55:36.476132 21057 leader_election.cc:288] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 00:55:36.476171 21061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 00:55:36.476279 21061 raft_consensus.cc:686] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [term 2 LEADER]: Becoming Leader. State: Replica: f584c344b1b44db7969f4860259b81b0, State: Running, Role: LEADER
I20260806 00:55:36.476409 21057 sys_catalog.cc:564] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:55:36.476470 21061 consensus_queue.cc:237] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f584c344b1b44db7969f4860259b81b0" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45547 } }
I20260806 00:55:36.476858 21064 sys_catalog.cc:455] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f584c344b1b44db7969f4860259b81b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f584c344b1b44db7969f4860259b81b0" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45547 } } }
I20260806 00:55:36.476951 21064 sys_catalog.cc:458] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:36.477183 21066 sys_catalog.cc:455] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f584c344b1b44db7969f4860259b81b0. Latest consensus state: current_term: 2 leader_uuid: "f584c344b1b44db7969f4860259b81b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f584c344b1b44db7969f4860259b81b0" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 45547 } } }
I20260806 00:55:36.477306 21066 sys_catalog.cc:458] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0 [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:36.477309 21073 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:55:36.477978 21073 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:55:36.478158 21073 catalog_manager.cc:1259] Loaded cluster ID: cbb374faf89044448e1ac1c4bf12cd87
I20260806 00:55:36.478230 21073 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:55:36.478341 21057 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 00:55:36.481777 21073 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:55:36.482376 21073 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0: Loaded TSK: 0
I20260806 00:55:36.482686 21073 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 00:55:36.578472 21059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:36.578740 21059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:36.578775 21059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:36.580524 21059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:36.580581 21059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:36.580621 21059 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:55:36.582798 21059 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.3.98.148:49519/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:41479
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=43523
--tserver_master_addrs=127.3.98.190:45547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:36.583048 21059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:36.583350 21059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:36.593035 21109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:36.593144 21111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:36.593389 21108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:36.593660 21059 server_base.cc:1034] running on GCE node
I20260806 00:55:36.593885 21059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:36.594180 21059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:36.595353 21059 hybrid_clock.cc:648] HybridClock initialized: now 1785977736595319 us; error 48 us; skew 500 ppm
Aug 06 00:55:36 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977736, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:36.598696 21059 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:55:36.599269 21059 webserver.cc:460] Webserver started at http://127.3.98.129:43523/ using document root <none> and password file <none>
I20260806 00:55:36.599534 21059 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:36.599622 21059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 00:55:36 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977736, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:55:36.621886 21059 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260806 00:55:36.622855 21122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:36.623076 21059 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:36.623157 21059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "5aa2993c088b4f1997d8b93d37325865"
format_stamp: "Formatted at 2026-08-06 00:55:35 on dist-test-slave-44d2"
server_key: "2ed1fd7550bc06812dc9cd8957c543af"
server_key_iv: "21af37ac2c54dcbdbe3eb1ee2e272de0"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:36.623601 21059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:36.650808 21059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:36.653177 21059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:36.653362 21059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:36.653668 21059 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:36.654094 21059 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:55:36.654188 21059 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:36.654254 21059 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:55:36.654299 21059 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:36.662055 21059 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:41479
I20260806 00:55:36.662189 21281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:41479 every 8 connection(s)
I20260806 00:55:36.662537 21059 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:55:36.662813 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 21059
I20260806 00:55:36.663156 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.98.148:49519/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:37425
--local_ip_for_outbound_sockets=127.3.98.130
--tserver_master_addrs=127.3.98.190:45547
--webserver_port=44365
--webserver_interface=127.3.98.130
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:44879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.3.98.148:49519/kms with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 00:55:36 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977736, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:36.681819 21285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:36.663327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:45547 (local address 127.3.98.129:43551)
0806 00:55:36.663503 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:36.663546 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:36.664051 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:36.665394 (+ 1343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:36.665399 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:36.665648 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:36.665932 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:36.665939 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:36.667754 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:36.667755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:36.669029 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:36.669032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:36.669903 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:36.669904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:36.670043 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:36.670632 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:36.670642 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:36.672281 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:36.679595 (+ 7314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:36.679602 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:36.679604 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:36.679947 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:36.680300 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:36.680301 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:36.680302 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:36.680449 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:36.681033 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:36.681040 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:36.681215 (+ 175us) client_negotiation.cc:769] Sending connection context
0806 00:55:36.681318 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 00:55:36.681492 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":99,"threads_started":1}
I20260806 00:55:36.682992 21287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:36.664623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:43551 (local address 127.3.98.190:45547)
0806 00:55:36.664851 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:36.664861 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:36.664903 (+ 42us) server_negotiation.cc:407] Connection header received
0806 00:55:36.665089 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:36.665097 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:36.665169 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:36.666094 (+ 925us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:36.666194 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:36.667607 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:36.669168 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:36.669763 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:36.670317 (+ 554us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:36.672409 (+ 2092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:36.672413 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:36.672413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:36.672424 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:36.679457 (+ 7033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:36.680062 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:36.680065 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:36.680065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:36.680204 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:36.680583 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:36.680585 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:36.680585 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:36.680932 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:36.682492 (+ 1560us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:36.682592 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 00:55:36.682736 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":92,"threads_started":1}
I20260806 00:55:36.684098 21282 heartbeater.cc:347] Connected to a master server at 127.3.98.190:45547
I20260806 00:55:36.684203 21282 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:36.684396 21282 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
W20260806 00:55:36.686211 21282 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:45547 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 00:55:36.686295 21282 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:36.686376 21282 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
I20260806 00:55:36.687017 21282 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:36.687094 21282 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
W20260806 00:55:36.687417 21282 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 00:55:36.783191 21288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:36.783443 21288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:36.783484 21288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:36.785043 21288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:36.785355 21288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:36.785442 21288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:55:36.787576 21288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.3.98.148:49519/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:37425
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=44365
--tserver_master_addrs=127.3.98.190:45547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:36.787853 21288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:36.788133 21288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:36.796141 21296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:36.796454 21299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:36.796736 21295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:36.796793 21288 server_base.cc:1034] running on GCE node
I20260806 00:55:36.796998 21288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:36.797279 21288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:36.798440 21288 hybrid_clock.cc:648] HybridClock initialized: now 1785977736798416 us; error 40 us; skew 500 ppm
Aug 06 00:55:36 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977736, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:36.801627 21288 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:55:36.802178 21288 webserver.cc:460] Webserver started at http://127.3.98.130:44365/ using document root <none> and password file <none>
I20260806 00:55:36.802429 21288 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:36.802516 21288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 00:55:36 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977736, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:55:36.820626 21288 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:36.821908 21312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:36.822108 21288 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:36.822211 21288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "88fc9355a6104425b4794ba6b1b71751"
format_stamp: "Formatted at 2026-08-06 00:55:35 on dist-test-slave-44d2"
server_key: "137d81c574550956418f60aba28cfab1"
server_key_iv: "20145d897fc555e6da1aaaaf35afe551"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:36.822769 21288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:36.847939 21288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:36.850937 21288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:36.851174 21288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:36.851493 21288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:36.851989 21288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:55:36.852068 21288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:36.852121 21288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:55:36.852155 21288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:36.861403 21288 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:37425
I20260806 00:55:36.861999 21288 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:55:36.862376 21465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:37425 every 8 connection(s)
I20260806 00:55:36.868314 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 21288
I20260806 00:55:36.868757 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.98.148:49519/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:40891
--local_ip_for_outbound_sockets=127.3.98.131
--tserver_master_addrs=127.3.98.190:45547
--webserver_port=46027
--webserver_interface=127.3.98.131
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:44879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.3.98.148:49519/kms with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 00:55:36 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977736, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:36.876979 21287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:36.863759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:42205 (local address 127.3.98.190:45547)
0806 00:55:36.863817 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:36.863820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:36.864201 (+ 381us) server_negotiation.cc:407] Connection header received
0806 00:55:36.865249 (+ 1048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:36.865251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:36.865268 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:36.865311 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:36.866307 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:36.867229 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:36.869110 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:36.869467 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:36.869523 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:36.872807 (+ 3284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:36.872808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:36.872809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:36.872818 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:36.874957 (+ 2139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:36.875542 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:36.875544 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:36.875544 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:36.875636 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:36.876014 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:36.876016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:36.876016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:36.876188 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:36.876258 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:36.876734 (+ 476us) server_negotiation.cc:299] Negotiation successful
0806 00:55:36.876864 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 00:55:36.877601 21469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:36.863416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:45547 (local address 127.3.98.130:42205)
0806 00:55:36.864059 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:36.864105 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:36.865085 (+ 980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:36.865541 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:36.865546 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:36.865821 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:36.866163 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:36.866171 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:36.867435 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:36.867436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:36.868920 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:36.868923 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:36.869659 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:36.869661 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:36.869843 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:36.870546 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:36.870558 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:36.872668 (+ 2110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:36.875082 (+ 2414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:36.875089 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:36.875092 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:36.875424 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:36.875730 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:36.875731 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:36.875732 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:36.875909 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:36.876300 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:36.876308 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:36.876508 (+ 200us) client_negotiation.cc:769] Sending connection context
0806 00:55:36.877152 (+ 644us) client_negotiation.cc:240] Negotiation successful
0806 00:55:36.877340 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":102,"threads_started":1}
I20260806 00:55:36.878196 21466 heartbeater.cc:347] Connected to a master server at 127.3.98.190:45547
I20260806 00:55:36.878319 21466 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:36.878539 21466 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
W20260806 00:55:36.879359 21466 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:45547 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 00:55:36.879474 21466 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:36.879591 21466 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
I20260806 00:55:36.880023 21466 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:36.880125 21466 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
W20260806 00:55:36.880527 21466 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 00:55:37.008213 21471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:37.008538 21471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:37.008592 21471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:37.010282 21471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:37.010349 21471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:37.010392 21471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:55:37.012717 21471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.3.98.148:49519/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:40891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=46027
--tserver_master_addrs=127.3.98.190:45547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:37.013005 21471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:37.013295 21471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:37.019904 21479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:37.020025 21481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:37.019930 21478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:37.020084 21471 server_base.cc:1034] running on GCE node
I20260806 00:55:37.020339 21471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:37.020620 21471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:37.021817 21471 hybrid_clock.cc:648] HybridClock initialized: now 1785977737021797 us; error 36 us; skew 500 ppm
Aug 06 00:55:37 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977737, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:37.028611 21471 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:55:37.029251 21471 webserver.cc:460] Webserver started at http://127.3.98.131:46027/ using document root <none> and password file <none>
I20260806 00:55:37.029552 21471 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:37.029652 21471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 00:55:37 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977737, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:55:37.049787 21471 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:37.050930 21495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:37.051112 21471 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 00:55:37.051211 21471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "642f1efd725443cc917d18361abd9cf1"
format_stamp: "Formatted at 2026-08-06 00:55:36 on dist-test-slave-44d2"
server_key: "47fc8559b54b66a3b64c3e17a6ddfc57"
server_key_iv: "bed0302b2863ccb0573dc9421dd9a869"
server_key_version: "kuduclusterkey@0"
I20260806 00:55:37.051712 21471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:37.071836 21471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:37.074777 21471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:37.074959 21471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:37.075238 21471 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:37.075665 21471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:55:37.075729 21471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:37.075771 21471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:55:37.075794 21471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:37.088994 21471 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:40891
I20260806 00:55:37.089604 21471 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:55:37.089864 21652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:40891 every 8 connection(s)
I20260806 00:55:37.099843 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 21471
Aug 06 00:55:37 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977737, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:37.114331 21287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:37.090532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:33421 (local address 127.3.98.190:45547)
0806 00:55:37.094010 (+ 3478us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:37.094012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:37.094023 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:55:37.094054 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:37.094055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:37.094067 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:37.094139 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:37.094853 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:37.095765 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:37.097301 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:37.097614 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:37.097697 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:37.104409 (+ 6712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:37.104411 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:37.104411 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:37.104421 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:37.112132 (+ 7711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:37.112844 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:37.112846 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:37.112846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:37.112922 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:37.113313 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:37.113314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:37.113315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:37.113541 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:37.113610 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:37.114128 (+ 518us) server_negotiation.cc:299] Negotiation successful
0806 00:55:37.114229 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3440}
I20260806 00:55:37.115345 21655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:37.090540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:45547 (local address 127.3.98.131:33421)
0806 00:55:37.090721 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:37.090765 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:37.091446 (+ 681us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:37.094245 (+ 2799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:37.094249 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:37.094494 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:37.094730 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:37.094735 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:37.095876 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:37.095877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:37.097196 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:37.097199 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:37.097793 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:37.097795 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:37.097945 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:37.098604 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:37.098615 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:37.104272 (+ 5657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:37.112222 (+ 7950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:37.112234 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:37.112238 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:37.112698 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:37.113016 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:37.113016 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:37.113017 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:37.113217 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:37.113656 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:37.113666 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:37.113897 (+ 231us) client_negotiation.cc:769] Sending connection context
0806 00:55:37.114720 (+ 823us) client_negotiation.cc:240] Negotiation successful
0806 00:55:37.114986 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260806 00:55:37.116350 21653 heartbeater.cc:347] Connected to a master server at 127.3.98.190:45547
I20260806 00:55:37.116472 21653 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:37.116755 21653 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
W20260806 00:55:37.117550 21653 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:45547 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 00:55:37.117636 21653 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:37.117700 21653 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
I20260806 00:55:37.118131 21653 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:37.118220 21653 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
W20260806 00:55:37.118604 21653 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 00:55:37.118806 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:37.100298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44130 (local address 127.3.98.190:45547)
0806 00:55:37.100418 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:37.100420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:37.100683 (+ 263us) server_negotiation.cc:407] Connection header received
0806 00:55:37.100707 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:37.100708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:37.100721 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:37.100794 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:37.102093 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:37.102975 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:37.104335 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:37.104734 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:37.104790 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:37.112030 (+ 7240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:37.112032 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:37.112032 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:37.112041 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:37.114012 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:37.114519 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:37.114520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:37.114521 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:37.114597 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:37.117236 (+ 2639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:37.117237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:37.117237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:37.117389 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:37.117942 (+ 553us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:37.118473 (+ 531us) server_negotiation.cc:299] Negotiation successful
0806 00:55:37.118714 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":67,"threads_started":1}
Aug 06 00:55:37 dist-test-slave-44d2 krb5kdc[19623](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785977737, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:37.687602 21282 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:37.687772 21282 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
I20260806 00:55:37.688134 21001 ts_manager.cc:194] Registered new tserver with Master: 5aa2993c088b4f1997d8b93d37325865 (127.3.98.129:41479)
I20260806 00:55:37.689227 21001 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:43551
I20260806 00:55:37.880709 21466 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:37.880879 21466 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
I20260806 00:55:37.881196 21000 ts_manager.cc:194] Registered new tserver with Master: 88fc9355a6104425b4794ba6b1b71751 (127.3.98.130:37425)
I20260806 00:55:37.881618 21000 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:42205
Aug 06 00:55:38 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977737, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:55:38.118808 21653 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:38.119043 21653 heartbeater.cc:511] Master 127.3.98.190:45547 requested a full tablet report, sending...
I20260806 00:55:38.119426 21000 ts_manager.cc:194] Registered new tserver with Master: 642f1efd725443cc917d18361abd9cf1 (127.3.98.131:40891)
I20260806 00:55:38.119864 21000 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:33421
I20260806 00:55:38.123138 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:55:38.131356 21688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:38.124437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44146 (local address 127.3.98.190:45547)
0806 00:55:38.124582 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:38.124585 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:38.124651 (+ 66us) server_negotiation.cc:407] Connection header received
0806 00:55:38.124731 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:38.124731 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:38.124744 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:38.124808 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:38.125369 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.125874 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.126728 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.126961 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.127034 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:38.128545 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:38.128547 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:38.128547 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:38.128555 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:38.130133 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:38.130524 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:38.130526 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:38.130526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:38.130590 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:38.130803 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:38.130804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:38.130804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:38.130926 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:38.131031 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:38.131145 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 00:55:38.131229 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260806 00:55:38.133375 21000 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:55:38.135149 21000 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:55:38.142781 21698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:38.138253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:41479 (local address 127.0.0.1:56746)
0806 00:55:38.138916 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:38.138958 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:38.139023 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:38.139303 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:38.139306 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:38.139308 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:38.139434 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:38.139438 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.140556 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.140558 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:38.141710 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:38.141713 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.142441 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.142442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:38.142525 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:38.142546 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 00:55:38.142636 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 00:55:38.142693 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":98,"threads_started":1}
I20260806 00:55:38.142784 21699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:38.138537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56746 (local address 127.3.98.129:41479)
0806 00:55:38.139133 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:38.139136 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:38.139145 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:55:38.139185 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:38.139187 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:38.139199 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:38.139299 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:38.139520 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.140410 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.141806 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.142328 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.142435 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:38.142501 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:38.142665 (+ 164us) server_negotiation.cc:299] Negotiation successful
0806 00:55:38.142705 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":84,"threads_started":1}
I20260806 00:55:38.144218 21175 tablet_service.cc:1467] Processing CreateTablet for tablet 055642fa11ed4c67b44728580d2ebb96 (DEFAULT_TABLE table=test-table [id=176c1a3306be4819a7f26b6dc230cd1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:55:38.144765 21175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 055642fa11ed4c67b44728580d2ebb96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:38.147324 21701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:38.138740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35726 (local address 127.3.98.131:40891)
0806 00:55:38.139052 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:38.139057 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:38.143046 (+ 3989us) server_negotiation.cc:407] Connection header received
0806 00:55:38.143155 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:38.143157 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:38.143174 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:38.143230 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:38.143468 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.144789 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.146098 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.146832 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.146884 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:38.146958 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:38.147188 (+ 230us) server_negotiation.cc:299] Negotiation successful
0806 00:55:38.147242 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":68,"threads_started":1}
I20260806 00:55:38.147574 21698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:38.138253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:40891 (local address 127.0.0.1:35726)
0806 00:55:38.142985 (+ 4732us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:38.142996 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:38.143076 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:38.143351 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:38.143352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:38.143353 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:38.143385 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:38.143386 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.144915 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.144916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:38.145985 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:38.145988 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.147021 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.147022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:38.147087 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:38.147091 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:55:38.147446 (+ 355us) client_negotiation.cc:240] Negotiation successful
0806 00:55:38.147503 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4719,"mutex_wait_us":2,"thread_start_us":99,"threads_started":1}
I20260806 00:55:38.148345 21565 tablet_service.cc:1467] Processing CreateTablet for tablet 055642fa11ed4c67b44728580d2ebb96 (DEFAULT_TABLE table=test-table [id=176c1a3306be4819a7f26b6dc230cd1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:55:38.148801 21565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 055642fa11ed4c67b44728580d2ebb96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:38.152971 21704 tablet_bootstrap.cc:492] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1: Bootstrap starting.
I20260806 00:55:38.153337 21695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:38.138532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:37425 (local address 127.0.0.1:37384)
0806 00:55:38.148645 (+ 10113us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:38.148659 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:38.148732 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:38.149178 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:38.149179 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:38.149181 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:38.149229 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:38.149231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.150623 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.150624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:38.151727 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:38.151730 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.152956 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.152957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:38.153123 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:38.153130 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 00:55:38.153186 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 00:55:38.153228 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10090,"thread_start_us":73,"threads_started":1}
I20260806 00:55:38.153689 21704 tablet_bootstrap.cc:654] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:38.153828 21700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:38.138656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37384 (local address 127.3.98.130:37425)
0806 00:55:38.140593 (+ 1937us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:38.140597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:38.148811 (+ 8214us) server_negotiation.cc:407] Connection header received
0806 00:55:38.148861 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:38.148864 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:38.148882 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:38.148959 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:38.149316 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.150516 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.151862 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.152767 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.152815 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:38.152874 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:38.153618 (+ 744us) server_negotiation.cc:299] Negotiation successful
0806 00:55:38.153672 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1896,"thread_start_us":62,"threads_started":1}
I20260806 00:55:38.154043 21704 log.cc:824] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:38.154408 21702 tablet_bootstrap.cc:492] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865: Bootstrap starting.
I20260806 00:55:38.154970 21702 tablet_bootstrap.cc:654] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:38.154872 21352 tablet_service.cc:1467] Processing CreateTablet for tablet 055642fa11ed4c67b44728580d2ebb96 (DEFAULT_TABLE table=test-table [id=176c1a3306be4819a7f26b6dc230cd1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:55:38.155257 21352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 055642fa11ed4c67b44728580d2ebb96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:38.155376 21702 log.cc:824] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:38.156418 21702 tablet_bootstrap.cc:492] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865: No bootstrap required, opened a new log
I20260806 00:55:38.156545 21702 ts_tablet_manager.cc:1397] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:55:38.158417 21702 raft_consensus.cc:348] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f1efd725443cc917d18361abd9cf1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 40891 } } peers { permanent_uuid: "88fc9355a6104425b4794ba6b1b71751" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37425 } } peers { permanent_uuid: "5aa2993c088b4f1997d8b93d37325865" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 41479 } }
I20260806 00:55:38.158573 21702 raft_consensus.cc:374] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:38.158617 21702 raft_consensus.cc:729] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5aa2993c088b4f1997d8b93d37325865, State: Initialized, Role: FOLLOWER
I20260806 00:55:38.158758 21702 consensus_queue.cc:260] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f1efd725443cc917d18361abd9cf1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 40891 } } peers { permanent_uuid: "88fc9355a6104425b4794ba6b1b71751" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37425 } } peers { permanent_uuid: "5aa2993c088b4f1997d8b93d37325865" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 41479 } }
I20260806 00:55:38.159032 21707 tablet_bootstrap.cc:492] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751: Bootstrap starting.
I20260806 00:55:38.159062 21702 ts_tablet_manager.cc:1428] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:55:38.159205 21282 heartbeater.cc:503] Master 127.3.98.190:45547 was elected leader, sending a full tablet report...
I20260806 00:55:38.159741 21707 tablet_bootstrap.cc:654] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:38.160053 21707 log.cc:824] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:38.160897 21707 tablet_bootstrap.cc:492] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751: No bootstrap required, opened a new log
I20260806 00:55:38.160980 21707 ts_tablet_manager.cc:1397] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:55:38.162662 21704 tablet_bootstrap.cc:492] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1: No bootstrap required, opened a new log
I20260806 00:55:38.162742 21704 ts_tablet_manager.cc:1397] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20260806 00:55:38.163249 21707 raft_consensus.cc:348] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f1efd725443cc917d18361abd9cf1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 40891 } } peers { permanent_uuid: "88fc9355a6104425b4794ba6b1b71751" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37425 } } peers { permanent_uuid: "5aa2993c088b4f1997d8b93d37325865" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 41479 } }
I20260806 00:55:38.163384 21707 raft_consensus.cc:374] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:38.163427 21707 raft_consensus.cc:729] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88fc9355a6104425b4794ba6b1b71751, State: Initialized, Role: FOLLOWER
I20260806 00:55:38.163549 21707 consensus_queue.cc:260] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f1efd725443cc917d18361abd9cf1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 40891 } } peers { permanent_uuid: "88fc9355a6104425b4794ba6b1b71751" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37425 } } peers { permanent_uuid: "5aa2993c088b4f1997d8b93d37325865" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 41479 } }
I20260806 00:55:38.163833 21707 ts_tablet_manager.cc:1428] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:55:38.163969 21466 heartbeater.cc:503] Master 127.3.98.190:45547 was elected leader, sending a full tablet report...
W20260806 00:55:38.165670 21284 tablet.cc:2369] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:55:38.165688 21704 raft_consensus.cc:348] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f1efd725443cc917d18361abd9cf1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 40891 } } peers { permanent_uuid: "88fc9355a6104425b4794ba6b1b71751" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37425 } } peers { permanent_uuid: "5aa2993c088b4f1997d8b93d37325865" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 41479 } }
I20260806 00:55:38.165843 21704 raft_consensus.cc:374] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:38.165875 21704 raft_consensus.cc:729] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642f1efd725443cc917d18361abd9cf1, State: Initialized, Role: FOLLOWER
I20260806 00:55:38.166304 21704 consensus_queue.cc:260] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f1efd725443cc917d18361abd9cf1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 40891 } } peers { permanent_uuid: "88fc9355a6104425b4794ba6b1b71751" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37425 } } peers { permanent_uuid: "5aa2993c088b4f1997d8b93d37325865" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 41479 } }
I20260806 00:55:38.166600 21704 ts_tablet_manager.cc:1428] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 00:55:38.166644 21653 heartbeater.cc:503] Master 127.3.98.190:45547 was elected leader, sending a full tablet report...
Aug 06 00:55:38 dist-test-slave-44d2 krb5kdc[19623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977737, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for HTTP/127.3.98.148@KRBTEST.COM
I20260806 00:55:38.326138 21712 raft_consensus.cc:482] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:55:38.326285 21712 raft_consensus.cc:504] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f1efd725443cc917d18361abd9cf1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 40891 } } peers { permanent_uuid: "88fc9355a6104425b4794ba6b1b71751" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37425 } } peers { permanent_uuid: "5aa2993c088b4f1997d8b93d37325865" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 41479 } }
I20260806 00:55:38.326697 21712 leader_election.cc:288] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 642f1efd725443cc917d18361abd9cf1 (127.3.98.131:40891), 5aa2993c088b4f1997d8b93d37325865 (127.3.98.129:41479)
I20260806 00:55:38.332554 21701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:38.327541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:37661 (local address 127.3.98.131:40891)
0806 00:55:38.328017 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:38.328020 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:38.328089 (+ 69us) server_negotiation.cc:407] Connection header received
0806 00:55:38.328194 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:38.328195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:38.328210 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:38.328238 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:38.328457 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.329242 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.331503 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.332090 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.332142 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:38.332152 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:38.332399 (+ 247us) server_negotiation.cc:299] Negotiation successful
0806 00:55:38.332444 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443}
I20260806 00:55:38.332850 21715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:38.327043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:40891 (local address 127.3.98.130:37661)
0806 00:55:38.328015 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:38.328028 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:38.328121 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:38.328306 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:38.328307 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:38.328309 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:38.328391 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:38.328393 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.329922 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.329923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:38.331206 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:38.331210 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.332240 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.332241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:38.332314 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:38.332319 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:55:38.332707 (+ 388us) client_negotiation.cc:240] Negotiation successful
0806 00:55:38.332753 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":949,"thread_start_us":125,"threads_started":1}
I20260806 00:55:38.333256 21574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "055642fa11ed4c67b44728580d2ebb96" candidate_uuid: "88fc9355a6104425b4794ba6b1b71751" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f1efd725443cc917d18361abd9cf1" is_pre_election: true
I20260806 00:55:38.333438 21574 raft_consensus.cc:2454] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88fc9355a6104425b4794ba6b1b71751 in term 0.
I20260806 00:55:38.333927 21314 leader_election.cc:302] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f1efd725443cc917d18361abd9cf1, 88fc9355a6104425b4794ba6b1b71751; no voters:
I20260806 00:55:38.334074 21712 raft_consensus.cc:2781] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:55:38.334134 21712 raft_consensus.cc:482] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:55:38.334167 21712 raft_consensus.cc:3037] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:38.335170 21712 raft_consensus.cc:504] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f1efd725443cc917d18361abd9cf1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 40891 } } peers { permanent_uuid: "88fc9355a6104425b4794ba6b1b71751" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37425 } } peers { permanent_uuid: "5aa2993c088b4f1997d8b93d37325865" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 41479 } }
I20260806 00:55:38.335322 21712 leader_election.cc:288] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [CANDIDATE]: Term 1 election: Requested vote from peers 642f1efd725443cc917d18361abd9cf1 (127.3.98.131:40891), 5aa2993c088b4f1997d8b93d37325865 (127.3.98.129:41479)
I20260806 00:55:38.335681 21574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "055642fa11ed4c67b44728580d2ebb96" candidate_uuid: "88fc9355a6104425b4794ba6b1b71751" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642f1efd725443cc917d18361abd9cf1"
I20260806 00:55:38.335786 21574 raft_consensus.cc:3037] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:38.336704 21574 raft_consensus.cc:2454] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88fc9355a6104425b4794ba6b1b71751 in term 1.
I20260806 00:55:38.336912 21314 leader_election.cc:302] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642f1efd725443cc917d18361abd9cf1, 88fc9355a6104425b4794ba6b1b71751; no voters:
I20260806 00:55:38.336983 21712 raft_consensus.cc:2781] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:55:38.337124 21712 raft_consensus.cc:686] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [term 1 LEADER]: Becoming Leader. State: Replica: 88fc9355a6104425b4794ba6b1b71751, State: Running, Role: LEADER
I20260806 00:55:38.337209 21712 consensus_queue.cc:237] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f1efd725443cc917d18361abd9cf1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 40891 } } peers { permanent_uuid: "88fc9355a6104425b4794ba6b1b71751" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37425 } } peers { permanent_uuid: "5aa2993c088b4f1997d8b93d37325865" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 41479 } }
I20260806 00:55:38.337843 21699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:38.327593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:59809 (local address 127.3.98.129:41479)
0806 00:55:38.327649 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:38.327652 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:38.331066 (+ 3414us) server_negotiation.cc:407] Connection header received
0806 00:55:38.331930 (+ 864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:38.331931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:38.331948 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:38.331982 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:38.332227 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.332963 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.336685 (+ 3722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.337251 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.337330 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:38.337340 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:38.337725 (+ 385us) server_negotiation.cc:299] Negotiation successful
0806 00:55:38.337775 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:55:38.338032 21000 catalog_manager.cc:5495] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88fc9355a6104425b4794ba6b1b71751 (127.3.98.130). New cstate: current_term: 1 leader_uuid: "88fc9355a6104425b4794ba6b1b71751" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "642f1efd725443cc917d18361abd9cf1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 40891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88fc9355a6104425b4794ba6b1b71751" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 37425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5aa2993c088b4f1997d8b93d37325865" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 41479 } health_report { overall_health: UNKNOWN } } }
I20260806 00:55:38.338754 21716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:38.327295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:41479 (local address 127.3.98.130:59809)
0806 00:55:38.330995 (+ 3700us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:38.331008 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:38.331099 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:38.332057 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:38.332058 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:38.332060 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:38.332140 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:38.332142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.333205 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.333206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:38.336054 (+ 2848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:38.336058 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.337553 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.337554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:38.337628 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:38.337632 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:55:38.338064 (+ 432us) client_negotiation.cc:240] Negotiation successful
0806 00:55:38.338108 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3673,"thread_start_us":58,"threads_started":1}
I20260806 00:55:38.339291 21221 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "055642fa11ed4c67b44728580d2ebb96" candidate_uuid: "88fc9355a6104425b4794ba6b1b71751" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5aa2993c088b4f1997d8b93d37325865" is_pre_election: true
I20260806 00:55:38.339443 21221 raft_consensus.cc:2454] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88fc9355a6104425b4794ba6b1b71751 in term 0.
I20260806 00:55:38.339570 21220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "055642fa11ed4c67b44728580d2ebb96" candidate_uuid: "88fc9355a6104425b4794ba6b1b71751" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5aa2993c088b4f1997d8b93d37325865"
I20260806 00:55:38.339637 21220 raft_consensus.cc:3037] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:38.340849 21220 raft_consensus.cc:2454] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88fc9355a6104425b4794ba6b1b71751 in term 1.
W20260806 00:55:38.341777 21654 tablet.cc:2369] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 00:55:38.363684 21467 tablet.cc:2369] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:55:38.375439 21700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:38.371825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37394 (local address 127.3.98.130:37425)
0806 00:55:38.371904 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:38.371906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:38.371914 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:55:38.371954 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:38.371955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:38.371981 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:38.372047 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:55:38.372234 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.373090 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.374296 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:38.374629 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:38.374690 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:38.374889 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:55:38.375026 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:55:38.375100 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:38.375322 (+ 222us) server_negotiation.cc:299] Negotiation successful
0806 00:55:38.375354 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 00:55:38.377920 21220 raft_consensus.cc:1261] T 055642fa11ed4c67b44728580d2ebb96 P 5aa2993c088b4f1997d8b93d37325865 [term 1 FOLLOWER]: Refusing update from remote peer 88fc9355a6104425b4794ba6b1b71751: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:55:38.377947 21574 raft_consensus.cc:1261] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1 [term 1 FOLLOWER]: Refusing update from remote peer 88fc9355a6104425b4794ba6b1b71751: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:55:38.378378 21717 consensus_queue.cc:1035] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [LEADER]: Connected to new peer: Peer: permanent_uuid: "642f1efd725443cc917d18361abd9cf1" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 40891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:55:38.378599 21712 consensus_queue.cc:1035] T 055642fa11ed4c67b44728580d2ebb96 P 88fc9355a6104425b4794ba6b1b71751 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5aa2993c088b4f1997d8b93d37325865" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:55:38.387619 21723 mvcc.cc:205] Tried to move back new op lower bound from 7315364816392687616 to 7315364816229634048. Current Snapshot: MvccSnapshot[applied={T|T < 7315364816392687616}]
I20260806 00:55:38.387748 21726 mvcc.cc:205] Tried to move back new op lower bound from 7315364816392687616 to 7315364816229634048. Current Snapshot: MvccSnapshot[applied={T|T < 7315364816392687616}]
I20260806 00:55:38.388746 21725 mvcc.cc:205] Tried to move back new op lower bound from 7315364816392687616 to 7315364816229634048. Current Snapshot: MvccSnapshot[applied={T|T < 7315364816392687616}]
I20260806 00:55:38.393009 21000 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:55:38.393126 21000 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:55:38.393937 21000 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f584c344b1b44db7969f4860259b81b0: Sending DeleteTablet for 3 replicas of tablet 055642fa11ed4c67b44728580d2ebb96
I20260806 00:55:38.394480 21565 tablet_service.cc:1514] Processing DeleteTablet for tablet 055642fa11ed4c67b44728580d2ebb96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:55:38 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:35726
I20260806 00:55:38.394728 21352 tablet_service.cc:1514] Processing DeleteTablet for tablet 055642fa11ed4c67b44728580d2ebb96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:55:38 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:37384
I20260806 00:55:38.395248 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 21059
W20260806 00:55:38.416683 20986 connection.cc:535] client connection to 127.3.98.129:41479 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 00:55:38.416854 20986 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 00:55:38.418031 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 21288
I20260806 00:55:38.449034 21735 tablet_replica.cc:330] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1: stopping tablet replica
I20260806 00:55:38.449241 21735 raft_consensus.cc:2229] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:55:38.449401 21735 raft_consensus.cc:2258] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:55:38.451167 21735 ts_tablet_manager.cc:1905] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:55:38.453050 21735 ts_tablet_manager.cc:1918] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:55:38.453140 21735 log.cc:1196] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/055642fa11ed4c67b44728580d2ebb96
I20260806 00:55:38.453446 21735 ts_tablet_manager.cc:1939] T 055642fa11ed4c67b44728580d2ebb96 P 642f1efd725443cc917d18361abd9cf1: Deleting consensus metadata
I20260806 00:55:38.465579 21695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:38.428922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:41479 (local address 127.0.0.1:56760)
0806 00:55:38.465459 (+ 36537us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:38.465535 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:41479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36504}
W20260806 00:55:38.465976 20986 catalog_manager.cc:4584] TS 5aa2993c088b4f1997d8b93d37325865 (127.3.98.129:41479): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 055642fa11ed4c67b44728580d2ebb96: Network error: Client connection negotiation failed: client connection to 127.3.98.129:41479: connect: Connection refused (error 111)
I20260806 00:55:38.466136 20985 catalog_manager.cc:4841] TS 642f1efd725443cc917d18361abd9cf1 (127.3.98.131:40891): tablet 055642fa11ed4c67b44728580d2ebb96 (table test-table [id=176c1a3306be4819a7f26b6dc230cd1c]) successfully deleted
W20260806 00:55:38.473888 21695 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:55:38.473606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:37425 (local address 127.0.0.1:37410)
0806 00:55:38.473659 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:38.473671 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:38.473709 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:38.473830 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.130:37425: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 00:55:38.474408 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 21471
I20260806 00:55:38.484401 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 20960
I20260806 00:55:38.494690 3466 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 00:55:38.839231 3466 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 00:55:38.839326 3466 mini_ranger.cc:66] Stopping Ranger...
I20260806 00:55:39.185076 3466 mini_ranger.cc:68] Stopped Ranger
2026-08-06 00:55:39.185 UTC [19664] LOG: received smart shutdown request
2026-08-06 00:55:39.189 UTC [19664] LOG: background worker "logical replication launcher" (PID 19673) exited with exit code 1
2026-08-06 00:55:39.189 UTC [19668] LOG: shutting down
2026-08-06 00:55:39.346 UTC [19664] LOG: database system is shut down
2026-08-06T00:55:39Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49035 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:55:39 dist-test-slave-44d2 krb5kdc[21748](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:55:39 dist-test-slave-44d2 krb5kdc[21748](info): set up 2 sockets
Aug 06 00:55:39 dist-test-slave-44d2 krb5kdc[21748](info): commencing operation
krb5kdc: starting...
W20260806 00:55:40.747627 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:55:40 dist-test-slave-44d2 krb5kdc[21748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:55:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:55:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:55:40.885499 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:41467
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:41467,127.3.98.189:44989,127.3.98.188:34685
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:55:40.971153 21767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:40.971511 21767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:40.971588 21767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:40.972935 21767 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:55:40.972985 21767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:40.973003 21767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:40.973066 21767 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:55:40.973101 21767 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:55:40.974768 21767 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:41467,127.3.98.189:44989,127.3.98.188:34685
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:41467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:40.975088 21767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:40.975373 21767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:40.980638 21776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:40.980638 21775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:40.980841 21767 server_base.cc:1034] running on GCE node
W20260806 00:55:40.980648 21778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:40.981207 21767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:40.981551 21767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:40.982717 21767 hybrid_clock.cc:648] HybridClock initialized: now 1785977740982695 us; error 40 us; skew 500 ppm
Aug 06 00:55:40 dist-test-slave-44d2 krb5kdc[21748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977740, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:40.985675 21767 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:55:40.986234 21767 webserver.cc:460] Webserver started at http://127.3.98.190:38561/ using document root <none> and password file <none>
I20260806 00:55:40.986501 21767 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:40.986579 21767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:40.986749 21767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:55:40.987944 21767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "d4b78e6da29d4f6eb9dbc756fbe38519"
format_stamp: "Formatted at 2026-08-06 00:55:40 on dist-test-slave-44d2"
server_key: "8c26ee929e02c0119ac1627e1d319259"
server_key_iv: "d59c9b1320f3852ddabc9c1234cb1232"
server_key_version: "encryptionkey@0"
I20260806 00:55:40.988520 21767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "d4b78e6da29d4f6eb9dbc756fbe38519"
format_stamp: "Formatted at 2026-08-06 00:55:40 on dist-test-slave-44d2"
server_key: "8c26ee929e02c0119ac1627e1d319259"
server_key_iv: "d59c9b1320f3852ddabc9c1234cb1232"
server_key_version: "encryptionkey@0"
I20260806 00:55:40.990182 21767 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:40.991081 21785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:40.991351 21767 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:40.991436 21767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "d4b78e6da29d4f6eb9dbc756fbe38519"
format_stamp: "Formatted at 2026-08-06 00:55:40 on dist-test-slave-44d2"
server_key: "8c26ee929e02c0119ac1627e1d319259"
server_key_iv: "d59c9b1320f3852ddabc9c1234cb1232"
server_key_version: "encryptionkey@0"
I20260806 00:55:40.991559 21767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:41.030579 21767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:41.033438 21767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:41.033629 21767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:41.038443 21767 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:41467
I20260806 00:55:41.038538 21857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:41467 every 8 connection(s)
I20260806 00:55:41.038936 21767 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:55:41.039901 21860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:41.041443 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 21767
I20260806 00:55:41.041555 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:55:41.041814 3466 external_mini_cluster.cc:1428] Setting key a60cc4b8b428ea3bb0eb4854371bb873
I20260806 00:55:41.041803 21860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977740, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.98.189@KRBTEST.COM; defaulting to no policy
I20260806 00:55:41.053277 21862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.042681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41467 (local address 127.0.0.1:44308)
0806 00:55:41.042887 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.042996 (+ 109us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:41.043519 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:41.043851 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:41.043854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:41.044174 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:41.044337 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.044341 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.045496 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.045497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.046201 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.046202 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.046827 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.046828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.046895 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.047549 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:41.047558 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:41.049745 (+ 2187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:41.051704 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.051711 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.051714 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.051906 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.052152 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.052153 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.052154 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.052239 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.052799 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:41.052806 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:41.052870 (+ 64us) client_negotiation.cc:769] Sending connection context
0806 00:55:41.052961 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 00:55:41.053104 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":102,"threads_started":1}
I20260806 00:55:41.053277 21863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.042769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44308 (local address 127.3.98.190:41467)
0806 00:55:41.042948 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.042959 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.043111 (+ 152us) server_negotiation.cc:407] Connection header received
0806 00:55:41.043690 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.043693 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.043714 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.043838 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.044455 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.045367 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.046305 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.046723 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.046858 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.049855 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.049863 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.049863 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.049870 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.051595 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.051993 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.051996 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.051996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.052081 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.052368 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.052369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.052369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.052717 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.052800 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.053006 (+ 206us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.053193 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":80,"server-negotiator.queue_time_us":153,"thread_start_us":102,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.189@KRBTEST.COM" created.
I20260806 00:55:41.054188 21860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:55:41.054618 21862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.054459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:44989 (local address 127.0.0.1:48548)
0806 00:55:41.054522 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.054586 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:44989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260806 00:55:41.054798 21790 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.98.189:44989: connect: Connection refused (error 111)
I20260806 00:55:41.055258 21862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.055150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:44989 (local address 127.0.0.1:48558)
0806 00:55:41.055195 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.055226 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:44989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260806 00:55:41.055419 21860 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.189:44989: Network error: Client connection negotiation failed: client connection to 127.3.98.189:44989: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.189.keytab.
Entry for principal kudu/127.3.98.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.189.keytab.
I20260806 00:55:41.075148 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.189:44989
--webserver_interface=127.3.98.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.189.keytab
--principal=kudu/127.3.98.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:41467,127.3.98.189:44989,127.3.98.188:34685
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:55:41.104703 21860 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } attempt: 1
I20260806 00:55:41.105233 21862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.105087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:44989 (local address 127.0.0.1:48570)
0806 00:55:41.105161 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.105202 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:44989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 00:55:41.105630 21862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.105530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:44989 (local address 127.0.0.1:48572)
0806 00:55:41.105577 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.105610 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:44989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 00:55:41.105723 21860 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.189:44989: Network error: Client connection negotiation failed: client connection to 127.3.98.189:44989: connect: Connection refused (error 111)
W20260806 00:55:41.160349 21869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:41.160607 21869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:41.160650 21869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:41.161795 21869 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:55:41.161864 21869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:41.161888 21869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:41.161909 21869 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:55:41.161942 21869 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:55:41.163465 21869 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:41467,127.3.98.189:44989,127.3.98.188:34685
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.189.keytab
--principal=kudu/127.3.98.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.189:44989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.3.98.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:41.163754 21869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:41.164026 21869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 00:55:41.169305 21869 server_base.cc:1034] running on GCE node
W20260806 00:55:41.169299 21876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:41.169287 21880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:41.169287 21875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:41.169780 21869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:41.170104 21869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:41.171277 21869 hybrid_clock.cc:648] HybridClock initialized: now 1785977741171274 us; error 40 us; skew 500 ppm
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977741, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:41.173995 21860 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } attempt: 2
I20260806 00:55:41.174196 21869 init.cc:377] Logged in from keytab as kudu/127.3.98.189@KRBTEST.COM (short username kudu)
I20260806 00:55:41.174506 21862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.174339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:44989 (local address 127.0.0.1:48574)
0806 00:55:41.174408 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.174459 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:44989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260806 00:55:41.174783 21869 webserver.cc:460] Webserver started at http://127.3.98.189:34861/ using document root <none> and password file <none>
I20260806 00:55:41.174958 21862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.174844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:44989 (local address 127.0.0.1:48580)
0806 00:55:41.174896 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.174922 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:44989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260806 00:55:41.175063 21860 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.189:44989: Network error: Client connection negotiation failed: client connection to 127.3.98.189:44989: connect: Connection refused (error 111)
I20260806 00:55:41.175118 21869 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:41.175185 21869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:41.175328 21869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:55:41.176409 21869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/data/instance:
uuid: "c7a47812ef274f9fb9b766522c8e1d09"
format_stamp: "Formatted at 2026-08-06 00:55:41 on dist-test-slave-44d2"
server_key: "4f38121b480d5b47acff9171402bba4a"
server_key_iv: "c1403aeae4cc2e12534d221bc2cc1097"
server_key_version: "encryptionkey@0"
I20260806 00:55:41.176860 21869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/wal/instance:
uuid: "c7a47812ef274f9fb9b766522c8e1d09"
format_stamp: "Formatted at 2026-08-06 00:55:41 on dist-test-slave-44d2"
server_key: "4f38121b480d5b47acff9171402bba4a"
server_key_iv: "c1403aeae4cc2e12534d221bc2cc1097"
server_key_version: "encryptionkey@0"
I20260806 00:55:41.178301 21869 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:55:41.179041 21889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:41.179212 21869 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:55:41.179318 21869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/wal
uuid: "c7a47812ef274f9fb9b766522c8e1d09"
format_stamp: "Formatted at 2026-08-06 00:55:41 on dist-test-slave-44d2"
server_key: "4f38121b480d5b47acff9171402bba4a"
server_key_iv: "c1403aeae4cc2e12534d221bc2cc1097"
server_key_version: "encryptionkey@0"
I20260806 00:55:41.179404 21869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:41.200408 21869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:41.202986 21869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:41.203171 21869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:41.207671 21869 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.189:44989
I20260806 00:55:41.207727 21957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.189:44989 every 8 connection(s)
I20260806 00:55:41.208130 21869 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/data/info.pb
I20260806 00:55:41.209146 21958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:41.210742 21958 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:55:41.211148 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 21869
I20260806 00:55:41.211268 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-1/wal/instance
I20260806 00:55:41.211504 3466 external_mini_cluster.cc:1428] Setting key 651238316227716d86d5bb5b6a019060
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977741, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.189@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.98.188@KRBTEST.COM; defaulting to no policy
I20260806 00:55:41.220772 21863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.211557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44322 (local address 127.3.98.190:41467)
0806 00:55:41.211609 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.211612 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.211841 (+ 229us) server_negotiation.cc:407] Connection header received
0806 00:55:41.212357 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.212359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.212378 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.212436 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.213122 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.213643 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.214856 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.215086 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.215156 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.217754 (+ 2598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.217756 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.217757 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.217766 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.219265 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.219737 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.219739 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.219739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.219803 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.220066 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.220067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.220067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.220200 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.220282 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.220583 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.220677 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 00:55:41.220978 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.211535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41467 (local address 127.0.0.1:44322)
0806 00:55:41.211711 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.211750 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:41.212246 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:41.212530 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:41.212534 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:41.212807 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:41.213010 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.213014 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.213747 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.213748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.214762 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.214766 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.215187 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.215188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.215357 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.215883 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:41.215894 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:41.217647 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:41.219395 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.219404 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.219406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.219638 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.219886 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.219887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.219887 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.219997 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.220272 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:41.220280 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:41.220430 (+ 150us) client_negotiation.cc:769] Sending connection context
0806 00:55:41.220560 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 00:55:41.220721 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
I20260806 00:55:41.221668 21958 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.188@KRBTEST.COM" created.
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977741, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.189@KRBTEST.COM for kudu/127.3.98.189@KRBTEST.COM
I20260806 00:55:41.229267 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.221932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:44989 (local address 127.0.0.1:48588)
0806 00:55:41.221982 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.221992 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:41.222028 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:41.222383 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:41.222384 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:41.222524 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:41.222568 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.222569 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.223560 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.223561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.224059 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.224061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.224610 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.224611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.224683 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.225117 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:41.225122 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:41.226269 (+ 1147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:41.228135 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.228136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.228136 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.228308 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.228556 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.228557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.228557 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.228612 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.228911 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:41.228912 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:41.228962 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 00:55:41.229052 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 00:55:41.229158 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 00:55:41.229370 21962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.222018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48588 (local address 127.3.98.189:44989)
0806 00:55:41.222210 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.222214 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.222239 (+ 25us) server_negotiation.cc:407] Connection header received
0806 00:55:41.222260 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.222262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.222274 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.222380 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.222652 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.223461 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.224139 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.224457 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.224611 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.226377 (+ 1766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.226386 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.226386 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.226393 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.228023 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.228409 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.228412 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.228412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.228468 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.228683 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.228684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.228684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.228822 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.228920 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.229087 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.229232 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":159,"thread_start_us":90,"threads_started":1}
I20260806 00:55:41.230172 21958 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:55:41.230548 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.230430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:34685 (local address 127.0.0.1:44014)
0806 00:55:41.230480 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.230527 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 00:55:41.230726 21892 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
I20260806 00:55:41.231207 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.231088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:34685 (local address 127.0.0.1:44030)
0806 00:55:41.231156 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.231185 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 00:55:41.231389 21958 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:34685: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.188.keytab.
Entry for principal kudu/127.3.98.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.188.keytab.
I20260806 00:55:41.239701 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.188:34685
--webserver_interface=127.3.98.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.188.keytab
--principal=kudu/127.3.98.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:41467,127.3.98.189:44989,127.3.98.188:34685
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:55:41.266243 21860 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } attempt: 3
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977740, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for kudu/127.3.98.189@KRBTEST.COM
I20260806 00:55:41.274282 21962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.266771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48598 (local address 127.3.98.189:44989)
0806 00:55:41.266840 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.266842 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.266878 (+ 36us) server_negotiation.cc:407] Connection header received
0806 00:55:41.266905 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.266905 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.266917 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.267004 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.267404 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.267991 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.269016 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.269221 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.269276 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.271438 (+ 2162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.271440 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.271440 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.271447 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.273048 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.273435 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.273437 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.273438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.273519 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.273729 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.273731 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.273731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.273847 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.273921 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.274104 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.274184 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 00:55:41.274282 21862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.266691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:44989 (local address 127.0.0.1:48598)
0806 00:55:41.266762 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.266774 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:41.266820 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:41.267018 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:41.267019 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:41.267227 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:41.267315 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.267318 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.268084 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.268086 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.268921 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.268924 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.269304 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.269306 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.269399 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.269892 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:41.269898 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:41.271312 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:41.273157 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.273158 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.273158 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.273345 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.273597 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.273598 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.273598 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.273663 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.273925 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:41.273926 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:41.273984 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 00:55:41.274063 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 00:55:41.274175 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 00:55:41.274669 21860 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:55:41.275058 21862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.274950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:34685 (local address 127.0.0.1:44038)
0806 00:55:41.275005 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.275037 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260806 00:55:41.275357 21862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.275272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:34685 (local address 127.0.0.1:44040)
0806 00:55:41.275315 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.275338 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260806 00:55:41.275452 21860 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:34685: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
I20260806 00:55:41.280561 21958 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } attempt: 1
I20260806 00:55:41.280953 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.280839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:34685 (local address 127.0.0.1:44042)
0806 00:55:41.280894 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.280921 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 00:55:41.281260 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.281170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:34685 (local address 127.0.0.1:44058)
0806 00:55:41.281217 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.281240 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 00:55:41.281350 21958 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:34685: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
I20260806 00:55:41.306596 21860 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } attempt: 1
I20260806 00:55:41.307256 21862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.307111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:34685 (local address 127.0.0.1:44068)
0806 00:55:41.307180 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.307225 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 00:55:41.307667 21862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.307581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:34685 (local address 127.0.0.1:44082)
0806 00:55:41.307625 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.307651 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 00:55:41.307781 21860 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:34685: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
W20260806 00:55:41.327387 21966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:41.327593 21966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:41.327648 21966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:41.328893 21966 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:55:41.328936 21966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:41.328951 21966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:41.328964 21966 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:55:41.328976 21966 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:55:41.330487 21966 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:41467,127.3.98.189:44989,127.3.98.188:34685
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.188.keytab
--principal=kudu/127.3.98.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.188:34685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.3.98.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:41.330745 21966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:41.330981 21966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:41.336002 21975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:41.335966 21972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:41.335937 21973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:41.336225 21966 server_base.cc:1034] running on GCE node
I20260806 00:55:41.336568 21966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:41.336862 21966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:41.338014 21966 hybrid_clock.cc:648] HybridClock initialized: now 1785977741338003 us; error 27 us; skew 500 ppm
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977741, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:41.340466 21966 init.cc:377] Logged in from keytab as kudu/127.3.98.188@KRBTEST.COM (short username kudu)
I20260806 00:55:41.340934 21966 webserver.cc:460] Webserver started at http://127.3.98.188:39137/ using document root <none> and password file <none>
I20260806 00:55:41.341172 21966 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:41.341240 21966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:41.341399 21966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:55:41.342509 21966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/data/instance:
uuid: "f20baadceeba4b86bf858d21a4b9b0fe"
format_stamp: "Formatted at 2026-08-06 00:55:41 on dist-test-slave-44d2"
server_key: "d80441f023a9e894bce9cde99b08290f"
server_key_iv: "7712d7968a54178c74d8bacb1e58d5c1"
server_key_version: "encryptionkey@0"
I20260806 00:55:41.342890 21966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/wal/instance:
uuid: "f20baadceeba4b86bf858d21a4b9b0fe"
format_stamp: "Formatted at 2026-08-06 00:55:41 on dist-test-slave-44d2"
server_key: "d80441f023a9e894bce9cde99b08290f"
server_key_iv: "7712d7968a54178c74d8bacb1e58d5c1"
server_key_version: "encryptionkey@0"
I20260806 00:55:41.344218 21966 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260806 00:55:41.345193 21985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:41.345410 21966 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:41.345539 21966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/wal
uuid: "f20baadceeba4b86bf858d21a4b9b0fe"
format_stamp: "Formatted at 2026-08-06 00:55:41 on dist-test-slave-44d2"
server_key: "d80441f023a9e894bce9cde99b08290f"
server_key_iv: "7712d7968a54178c74d8bacb1e58d5c1"
server_key_version: "encryptionkey@0"
I20260806 00:55:41.345631 21966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:41.349499 21958 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } attempt: 2
I20260806 00:55:41.349941 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.349807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:34685 (local address 127.0.0.1:44098)
0806 00:55:41.349871 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.349910 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 00:55:41.350302 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.350221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:34685 (local address 127.0.0.1:44110)
0806 00:55:41.350263 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.350286 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 00:55:41.350420 21958 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:34685: Network error: Client connection negotiation failed: client connection to 127.3.98.188:34685: connect: Connection refused (error 111)
I20260806 00:55:41.373462 21966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:41.375545 21966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:41.375717 21966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:41.379828 21966 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.188:34685
I20260806 00:55:41.379930 22061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.188:34685 every 8 connection(s)
I20260806 00:55:41.380259 21966 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/data/info.pb
I20260806 00:55:41.381212 22062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:41.382912 21860 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } attempt: 2
I20260806 00:55:41.382933 22062 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:55:41.385769 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 21966
I20260806 00:55:41.385914 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785977579314977-3466-0/minicluster-data/master-2/wal/instance
I20260806 00:55:41.386113 3466 external_mini_cluster.cc:1428] Setting key f22e6bda0983c2be96c3e7c3b1220325
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977740, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for kudu/127.3.98.188@KRBTEST.COM
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977741, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.188@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.188@KRBTEST.COM
I20260806 00:55:41.393242 21862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.383321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:34685 (local address 127.0.0.1:44122)
0806 00:55:41.383394 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.383409 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:41.383469 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:41.384376 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:41.384378 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:41.384585 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:41.384628 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.384630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.385734 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.385735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.386510 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.386512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.387248 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.387249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.387297 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.387772 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:41.387778 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:41.389288 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:41.391503 (+ 2215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.391504 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.391505 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.391811 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.392181 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.392182 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.392182 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.392300 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.392831 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:41.392833 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:41.392881 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 00:55:41.393027 (+ 146us) client_negotiation.cc:240] Negotiation successful
0806 00:55:41.393129 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 00:55:41.393512 22064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.383451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44122 (local address 127.3.98.188:34685)
0806 00:55:41.383631 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.383640 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.383669 (+ 29us) server_negotiation.cc:407] Connection header received
0806 00:55:41.384228 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.384235 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.384257 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.384370 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.384739 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.385625 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.386631 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.387179 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.387284 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.389380 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.389389 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.389389 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.389396 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.391428 (+ 2032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.391917 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.391921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.391921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.392088 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.392390 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.392391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.392391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.392740 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.392831 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.393108 (+ 277us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.393250 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":86,"threads_started":1}
I20260806 00:55:41.394235 21863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.383959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44330 (local address 127.3.98.190:41467)
0806 00:55:41.384013 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.384015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.384191 (+ 176us) server_negotiation.cc:407] Connection header received
0806 00:55:41.384333 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.384335 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.384345 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.384401 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.384983 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.385447 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.386772 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.387076 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.387151 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.390923 (+ 3772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.390925 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.390926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.390933 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.392595 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.393122 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.393124 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.393124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.393182 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.393391 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.393391 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.393392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.393513 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.393559 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.394063 (+ 504us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.394153 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 00:55:41.394481 22065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.383881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:41467 (local address 127.0.0.1:44330)
0806 00:55:41.384060 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.384112 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:41.384244 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:41.384421 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:41.384423 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:41.384735 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:41.384884 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.384889 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.385534 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.385535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.386661 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.386664 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.387171 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.387172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.387286 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.387993 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:41.388003 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:41.390826 (+ 2823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:41.392701 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.392709 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.392711 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.393030 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.393262 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.393262 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.393263 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.393319 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.393838 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:41.393842 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:41.393896 (+ 54us) client_negotiation.cc:769] Sending connection context
0806 00:55:41.394013 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 00:55:41.394131 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":116,"threads_started":1}
I20260806 00:55:41.395047 22062 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:55:41.396086 21860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519: Bootstrap starting.
I20260806 00:55:41.396386 22068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.386633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44128 (local address 127.3.98.188:34685)
0806 00:55:41.386808 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.386809 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.386815 (+ 6us) server_negotiation.cc:407] Connection header received
0806 00:55:41.386830 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.386831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.386838 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.386920 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.387698 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.388394 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.389502 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.389797 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.389885 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.392677 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.392678 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.392679 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.392685 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.395112 (+ 2427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.395504 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.395505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.395506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.395568 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.395773 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.395774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.395774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.395964 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.396114 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.396197 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.396277 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":102,"threads_started":1}
I20260806 00:55:41.396865 21860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:41.397099 21860 log.cc:824] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:41.398044 21860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519: No bootstrap required, opened a new log
I20260806 00:55:41.400111 21860 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } }
I20260806 00:55:41.400251 21860 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:41.400282 21860 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4b78e6da29d4f6eb9dbc756fbe38519, State: Initialized, Role: FOLLOWER
I20260806 00:55:41.400445 21860 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } }
I20260806 00:55:41.400822 21860 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:55:41.400795 22072 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } } }
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977741, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.188@KRBTEST.COM for kudu/127.3.98.189@KRBTEST.COM
I20260806 00:55:41.401147 22072 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [sys.catalog]: This master's current role is: FOLLOWER
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
W20260806 00:55:41.403254 22085 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 00:55:41.403349 22085 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:55:41.405131 22065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.395300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:44989 (local address 127.0.0.1:48610)
0806 00:55:41.395344 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.395354 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:41.395388 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:41.397434 (+ 2046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:41.397435 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:41.397589 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:41.397675 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.397676 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.398661 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.398662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.399267 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.399269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.399658 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.399659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.399734 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.400160 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:41.400165 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:41.401705 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:41.403659 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.403660 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.403661 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.403870 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.404121 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.404122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.404123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.404187 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.404801 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:41.404802 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:41.404849 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 00:55:41.404923 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 00:55:41.405016 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 00:55:41.405723 21962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.395406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48610 (local address 127.3.98.189:44989)
0806 00:55:41.397302 (+ 1896us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.397305 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.397313 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:55:41.397339 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.397340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.397348 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.397402 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.397878 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.398564 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.399367 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.399577 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.399649 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.401798 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.401799 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.401800 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.401809 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.403573 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.403965 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.403966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.403966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.404042 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.404536 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.404537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.404538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.404685 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.404770 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.405531 (+ 761us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.405624 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1867}
I20260806 00:55:41.406654 21863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.398176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44340 (local address 127.3.98.190:41467)
0806 00:55:41.398212 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.398213 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.398222 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:55:41.398284 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.398285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.398294 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.398348 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.398891 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.399567 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.400589 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.400854 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.400902 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.403754 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.403755 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.403756 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.403763 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.405479 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.405888 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.405890 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.405890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.405944 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.406156 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.406157 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.406157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.406270 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.406437 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.406478 (+ 41us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.406555 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:55:41.404608 21767 master_runner.cc:186] Error getting master registration for 127.3.98.189:44989: OK, instance_id { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" instance_seqno: 1785977741206382 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 00:55:41.407662 21767 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 00:55:41.408031 22062 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977741, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.188@KRBTEST.COM for kudu/127.3.98.188@KRBTEST.COM
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.189@KRBTEST.COM
I20260806 00:55:41.415838 22065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.408317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:34685 (local address 127.0.0.1:44132)
0806 00:55:41.408360 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.408369 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:41.408402 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:41.408675 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:41.408676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:41.408824 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:41.408857 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.408859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.409655 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.409656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.410146 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.410148 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.410613 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.410614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.410664 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.411130 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:41.411136 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:41.412365 (+ 1229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:41.414616 (+ 2251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.414617 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.414617 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.414897 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.415113 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.415114 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.415115 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.415171 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.415516 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:41.415518 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:41.415556 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 00:55:41.415616 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 00:55:41.415713 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260806 00:55:41.416194 22068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.408356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44132 (local address 127.3.98.188:34685)
0806 00:55:41.408564 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.408573 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.408580 (+ 7us) server_negotiation.cc:407] Connection header received
0806 00:55:41.408597 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.408597 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.408607 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.408915 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.408935 (+ 20us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.409564 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.410232 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.410521 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.410819 (+ 298us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.412472 (+ 1653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.412474 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.412474 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.412528 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.414492 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.414973 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.414974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.414975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.415037 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.415256 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.415257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.415258 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.415437 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.415984 (+ 547us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.416029 (+ 45us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.416105 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192}
I20260806 00:55:41.417870 21962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.407764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48626 (local address 127.3.98.189:44989)
0806 00:55:41.407812 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.407814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.407821 (+ 7us) server_negotiation.cc:407] Connection header received
0806 00:55:41.407839 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.407839 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.407847 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.407926 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.408576 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.409325 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.410337 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.410630 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.410693 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.413628 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.413630 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.413630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.413637 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.415749 (+ 2112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.416303 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.416305 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.416305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.416364 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.416691 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.416692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.416692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.416837 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.417648 (+ 811us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.417698 (+ 50us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.417780 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:55:41.418023 22062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe: Bootstrap starting.
I20260806 00:55:41.418658 22062 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:41.418962 22062 log.cc:824] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:41.419874 22062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe: No bootstrap required, opened a new log
I20260806 00:55:41.420511 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:55:41.422197 22062 raft_consensus.cc:348] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } }
I20260806 00:55:41.422456 22062 raft_consensus.cc:374] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:41.422569 22062 raft_consensus.cc:729] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20baadceeba4b86bf858d21a4b9b0fe, State: Initialized, Role: FOLLOWER
I20260806 00:55:41.422789 22062 consensus_queue.cc:260] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } }
I20260806 00:55:41.423225 22062 sys_catalog.cc:564] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [sys.catalog]: configured and running, proceeding with master startup.
W20260806 00:55:41.425371 22110 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 00:55:41.425477 22110 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:55:41.425925 22097 sys_catalog.cc:455] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } } }
I20260806 00:55:41.426920 22097 sys_catalog.cc:458] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:55:41.426460 21966 master_runner.cc:186] Error getting master registration for 127.3.98.189:44989: OK, instance_id { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" instance_seqno: 1785977741206382 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 00:55:41.429000 21966 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 00:55:41.433097 21863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.422072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44342 (local address 127.3.98.190:41467)
0806 00:55:41.422116 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.422118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.422679 (+ 561us) server_negotiation.cc:407] Connection header received
0806 00:55:41.422780 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.422781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.422791 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.422821 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.423586 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.424341 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.426151 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.426451 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.426497 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.430113 (+ 3616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.430114 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.430115 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.430123 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.431748 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.432169 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.432170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.432171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.432229 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.432425 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.432425 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.432426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.432600 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.432698 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.432905 (+ 207us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.433000 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:55:41.435127 22068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.422399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44138 (local address 127.3.98.188:34685)
0806 00:55:41.422432 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.422434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.425772 (+ 3338us) server_negotiation.cc:407] Connection header received
0806 00:55:41.426158 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.426159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.426170 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.426198 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.427090 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.427746 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.428728 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.428989 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.429032 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.431985 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.431987 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.431987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.431994 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.433740 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.434261 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.434262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.434262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.434326 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.434549 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.434550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.434551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.434678 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.434745 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.434944 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.435037 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 00:55:41.437757 21962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.422061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48630 (local address 127.3.98.189:44989)
0806 00:55:41.422101 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.422103 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.422362 (+ 259us) server_negotiation.cc:407] Connection header received
0806 00:55:41.422453 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.422454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.422464 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.422493 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.423209 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.423970 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.425149 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.425443 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.425486 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.434475 (+ 8989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.434477 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.434477 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.434485 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.436328 (+ 1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.436813 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.436814 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.436815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.436882 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.437150 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.437152 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.437152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.437298 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.437395 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.437572 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.437662 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:55:41.441565 21958 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } attempt: 3
Aug 06 00:55:41 dist-test-slave-44d2 krb5kdc[21748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977741, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.189@KRBTEST.COM for kudu/127.3.98.188@KRBTEST.COM
I20260806 00:55:41.450142 21960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.441820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:34685 (local address 127.0.0.1:44142)
0806 00:55:41.441864 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:41.441875 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:41.441912 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:41.442112 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:41.442114 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:41.442275 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:41.442342 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.442343 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.443307 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.443308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.444122 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:41.444124 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.444661 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.444662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:41.444727 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.445172 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:41.445177 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:41.446730 (+ 1553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:41.449063 (+ 2333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.449064 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.449065 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.449287 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.449485 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:41.449486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:41.449486 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:41.449540 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:41.449820 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:41.449821 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:41.449865 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 00:55:41.449928 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 00:55:41.450026 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 00:55:41.450663 22068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:41.441917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44142 (local address 127.3.98.188:34685)
0806 00:55:41.441967 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:41.441969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:41.441976 (+ 7us) server_negotiation.cc:407] Connection header received
0806 00:55:41.441995 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:41.441996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:41.442006 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:41.442060 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:41.442430 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.443214 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.444213 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:41.444578 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:41.444650 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:41.446824 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:41.446825 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:41.446826 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:41.446834 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:41.448969 (+ 2135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.449366 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.449367 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.449367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.449421 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:41.449604 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:41.449605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:41.449605 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:41.449735 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:41.449793 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:41.450496 (+ 703us) server_negotiation.cc:299] Negotiation successful
0806 00:55:41.450573 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:55:41.452216 21958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09: Bootstrap starting.
I20260806 00:55:41.453079 21958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:41.453395 21958 log.cc:824] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:41.454366 21958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09: No bootstrap required, opened a new log
I20260806 00:55:41.456388 21958 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } }
I20260806 00:55:41.456624 21958 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:41.456715 21958 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7a47812ef274f9fb9b766522c8e1d09, State: Initialized, Role: FOLLOWER
I20260806 00:55:41.456879 21958 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } }
I20260806 00:55:41.457270 21958 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:55:41.457904 22115 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } } }
I20260806 00:55:41.458062 22115 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 00:55:41.459188 22133 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 00:55:41.459300 22133 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:55:41.460919 21869 master_runner.cc:263] No leader master found from master c7a47812ef274f9fb9b766522c8e1d09
I20260806 00:55:41.460980 21869 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 00:55:41.534591 21792 tablet.cc:2369] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:55:41.550697 22097 raft_consensus.cc:482] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:55:41.550832 22097 raft_consensus.cc:504] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } }
I20260806 00:55:41.551074 22097 leader_election.cc:288] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4b78e6da29d4f6eb9dbc756fbe38519 (127.3.98.190:41467), c7a47812ef274f9fb9b766522c8e1d09 (127.3.98.189:44989)
I20260806 00:55:41.551595 21924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a47812ef274f9fb9b766522c8e1d09" is_pre_election: true
I20260806 00:55:41.551746 21924 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f20baadceeba4b86bf858d21a4b9b0fe in term 0.
I20260806 00:55:41.552096 21993 leader_election.cc:302] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c7a47812ef274f9fb9b766522c8e1d09, f20baadceeba4b86bf858d21a4b9b0fe; no voters:
I20260806 00:55:41.552294 22097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:55:41.552341 22097 raft_consensus.cc:482] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:55:41.552361 22097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:41.553436 22097 raft_consensus.cc:504] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } }
I20260806 00:55:41.553562 22097 leader_election.cc:288] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [CANDIDATE]: Term 1 election: Requested vote from peers d4b78e6da29d4f6eb9dbc756fbe38519 (127.3.98.190:41467), c7a47812ef274f9fb9b766522c8e1d09 (127.3.98.189:44989)
I20260806 00:55:41.553983 21824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519"
I20260806 00:55:41.554122 21824 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:41.554790 21824 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20baadceeba4b86bf858d21a4b9b0fe in term 1.
I20260806 00:55:41.554937 21825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" is_pre_election: true
I20260806 00:55:41.555048 21825 raft_consensus.cc:2362] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f20baadceeba4b86bf858d21a4b9b0fe in term 1. Re-sending same reply.
I20260806 00:55:41.555189 21990 leader_election.cc:302] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4b78e6da29d4f6eb9dbc756fbe38519, f20baadceeba4b86bf858d21a4b9b0fe; no voters:
I20260806 00:55:41.555294 21924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7a47812ef274f9fb9b766522c8e1d09"
I20260806 00:55:41.555374 21924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:41.555985 21924 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f20baadceeba4b86bf858d21a4b9b0fe in term 1.
I20260806 00:55:41.556160 22097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:55:41.556375 22097 raft_consensus.cc:686] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [term 1 LEADER]: Becoming Leader. State: Replica: f20baadceeba4b86bf858d21a4b9b0fe, State: Running, Role: LEADER
I20260806 00:55:41.556468 22097 consensus_queue.cc:237] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } }
I20260806 00:55:41.557947 22136 sys_catalog.cc:455] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader f20baadceeba4b86bf858d21a4b9b0fe. Latest consensus state: current_term: 1 leader_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } } }
I20260806 00:55:41.558092 22136 sys_catalog.cc:458] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:41.558295 22139 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:55:41.558537 22139 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:55:41.559809 21924 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [term 1 FOLLOWER]: Refusing update from remote peer f20baadceeba4b86bf858d21a4b9b0fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:55:41.559890 21825 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [term 1 FOLLOWER]: Refusing update from remote peer f20baadceeba4b86bf858d21a4b9b0fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:55:41.560163 22136 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:55:41.560364 22136 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:55:41.561535 22072 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f20baadceeba4b86bf858d21a4b9b0fe. Latest consensus state: current_term: 1 leader_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } } }
I20260806 00:55:41.561542 22115 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f20baadceeba4b86bf858d21a4b9b0fe. Latest consensus state: current_term: 1 leader_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } } }
I20260806 00:55:41.561625 22072 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:55:41.561653 22115 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:55:41.562414 22136 sys_catalog.cc:455] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } } }
I20260806 00:55:41.562506 22136 sys_catalog.cc:458] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:41.562964 22072 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } } }
I20260806 00:55:41.563047 22072 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:55:41.563268 22139 catalog_manager.cc:1347] Generated new cluster ID: d55b006ef23f4366aab8dda910f92849
I20260806 00:55:41.563360 22139 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:55:41.563890 22097 sys_catalog.cc:455] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } } }
I20260806 00:55:41.563985 22097 sys_catalog.cc:458] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:41.564409 22115 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4b78e6da29d4f6eb9dbc756fbe38519" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 41467 } } peers { permanent_uuid: "c7a47812ef274f9fb9b766522c8e1d09" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 44989 } } peers { permanent_uuid: "f20baadceeba4b86bf858d21a4b9b0fe" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 34685 } } }
I20260806 00:55:41.564658 22115 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:55:41.564829 22143 mvcc.cc:205] Tried to move back new op lower bound from 7315364829427027968 to 7315364829416157184. Current Snapshot: MvccSnapshot[applied={T|T < 7315364829427027968}]
I20260806 00:55:41.580686 22139 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:55:41.581389 22139 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:55:41.591598 22139 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f20baadceeba4b86bf858d21a4b9b0fe: Generated new TSK 0
I20260806 00:55:41.591899 22139 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:55:42.403860 22085 catalog_manager.cc:1259] Loaded cluster ID: d55b006ef23f4366aab8dda910f92849
I20260806 00:55:42.403944 22085 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519: loading cluster ID for follower catalog manager: success
I20260806 00:55:42.404829 22085 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519: acquiring CA information for follower catalog manager: success
I20260806 00:55:42.405117 22085 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d4b78e6da29d4f6eb9dbc756fbe38519: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 00:55:42.459789 22133 catalog_manager.cc:1259] Loaded cluster ID: d55b006ef23f4366aab8dda910f92849
I20260806 00:55:42.459874 22133 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09: loading cluster ID for follower catalog manager: success
I20260806 00:55:42.460703 22133 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09: acquiring CA information for follower catalog manager: success
I20260806 00:55:42.460963 22133 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c7a47812ef274f9fb9b766522c8e1d09: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 00:55:42.656225 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 21767
I20260806 00:55:42.666635 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 21869
W20260806 00:55:42.675748 21993 connection.cc:535] client connection to 127.3.98.189:44989 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 00:55:42.675905 21993 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 00:55:42.676059 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 21966
2026-08-06T00:55:42Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3221 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:55:42 dist-test-slave-44d2 krb5kdc[22163](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:55:42 dist-test-slave-44d2 krb5kdc[22163](info): set up 2 sockets
Aug 06 00:55:42 dist-test-slave-44d2 krb5kdc[22163](info): commencing operation
krb5kdc: starting...
W20260806 00:55:43.901909 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:55:43 dist-test-slave-44d2 krb5kdc[22163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:55:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:55:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:55:44.027840 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:43681
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:34571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:43681
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:55:44.112915 22184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:44.113142 22184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:44.113166 22184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:44.114276 22184 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:55:44.114327 22184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:44.114341 22184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:44.114354 22184 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:55:44.114372 22184 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:55:44.115810 22184 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:34571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:43681
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:43681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:44.116015 22184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:44.116202 22184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:44.121593 22190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:44.121683 22184 server_base.cc:1034] running on GCE node
W20260806 00:55:44.121773 22191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:44.121814 22194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:44.122048 22184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:44.122299 22184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:44.123445 22184 hybrid_clock.cc:648] HybridClock initialized: now 1785977744123431 us; error 31 us; skew 500 ppm
Aug 06 00:55:44 dist-test-slave-44d2 krb5kdc[22163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977744, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:44.125959 22184 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:55:44.126442 22184 webserver.cc:460] Webserver started at http://127.3.98.190:36063/ using document root <none> and password file <none>
I20260806 00:55:44.126675 22184 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:44.126752 22184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:44.126909 22184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:55:44.127964 22184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "f3d3563e89b148d5bcf823a6c2c8c1a1"
format_stamp: "Formatted at 2026-08-06 00:55:44 on dist-test-slave-44d2"
server_key: "c3386c67185e01f234ff378ab194e372"
server_key_iv: "7d3a6434c5b4b7b15be1409b3bee4acf"
server_key_version: "encryptionkey@0"
I20260806 00:55:44.128351 22184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "f3d3563e89b148d5bcf823a6c2c8c1a1"
format_stamp: "Formatted at 2026-08-06 00:55:44 on dist-test-slave-44d2"
server_key: "c3386c67185e01f234ff378ab194e372"
server_key_iv: "7d3a6434c5b4b7b15be1409b3bee4acf"
server_key_version: "encryptionkey@0"
I20260806 00:55:44.129747 22184 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:55:44.130488 22206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:44.130692 22184 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:55:44.130793 22184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "f3d3563e89b148d5bcf823a6c2c8c1a1"
format_stamp: "Formatted at 2026-08-06 00:55:44 on dist-test-slave-44d2"
server_key: "c3386c67185e01f234ff378ab194e372"
server_key_iv: "7d3a6434c5b4b7b15be1409b3bee4acf"
server_key_version: "encryptionkey@0"
I20260806 00:55:44.130877 22184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:44.146855 22184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:44.148888 22184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:44.149055 22184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:44.153177 22184 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:43681
I20260806 00:55:44.153258 22275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:43681 every 8 connection(s)
I20260806 00:55:44.153611 22184 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:55:44.154470 22276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:44.156817 22276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1: Bootstrap starting.
I20260806 00:55:44.157388 22276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:44.157703 22276 log.cc:824] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:44.158455 22276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1: No bootstrap required, opened a new log
I20260806 00:55:44.160108 22276 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3d3563e89b148d5bcf823a6c2c8c1a1" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 43681 } }
I20260806 00:55:44.160244 22276 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:44.160266 22276 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3d3563e89b148d5bcf823a6c2c8c1a1, State: Initialized, Role: FOLLOWER
I20260806 00:55:44.160440 22276 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3d3563e89b148d5bcf823a6c2c8c1a1" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 43681 } }
I20260806 00:55:44.160557 22276 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:55:44.160604 22276 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:55:44.160679 22276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:44.161247 22276 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3d3563e89b148d5bcf823a6c2c8c1a1" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 43681 } }
I20260806 00:55:44.161369 22276 leader_election.cc:302] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3d3563e89b148d5bcf823a6c2c8c1a1; no voters:
I20260806 00:55:44.161556 22276 leader_election.cc:288] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:55:44.161584 22280 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:55:44.161759 22280 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [term 1 LEADER]: Becoming Leader. State: Replica: f3d3563e89b148d5bcf823a6c2c8c1a1, State: Running, Role: LEADER
I20260806 00:55:44.161813 22276 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:55:44.161900 22280 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3d3563e89b148d5bcf823a6c2c8c1a1" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 43681 } }
I20260806 00:55:44.162484 22282 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3d3563e89b148d5bcf823a6c2c8c1a1. Latest consensus state: current_term: 1 leader_uuid: "f3d3563e89b148d5bcf823a6c2c8c1a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3d3563e89b148d5bcf823a6c2c8c1a1" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 43681 } } }
I20260806 00:55:44.162595 22282 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:44.162770 22281 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3d3563e89b148d5bcf823a6c2c8c1a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3d3563e89b148d5bcf823a6c2c8c1a1" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 43681 } } }
I20260806 00:55:44.162845 22281 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1 [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:44.162874 22293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:55:44.163389 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 22184
I20260806 00:55:44.163471 22293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:55:44.163518 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:55:44.163719 3466 external_mini_cluster.cc:1428] Setting key e912464d32742bd81ed51da09bbec958
I20260806 00:55:44.168823 22293 catalog_manager.cc:1347] Generated new cluster ID: 7d9ecab3cf2f4e578cd7290b3d5dcda9
I20260806 00:55:44.168880 22293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:55:44 dist-test-slave-44d2 krb5kdc[22163](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:44.173883 22307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:44.164352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36092 (local address 127.3.98.190:43681)
0806 00:55:44.164522 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:44.164531 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:44.164564 (+ 33us) server_negotiation.cc:407] Connection header received
0806 00:55:44.164695 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:44.164702 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:44.164759 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:44.164905 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:44.165551 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:44.166497 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:44.167281 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:44.167703 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:44.167824 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:44.170367 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:44.170370 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:44.170371 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:44.170391 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:44.172214 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:44.172613 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:44.172616 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:44.172617 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:44.172707 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:44.172931 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:44.172932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:44.172932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:44.173167 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:44.173327 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:44.173444 (+ 117us) server_negotiation.cc:299] Negotiation successful
0806 00:55:44.173696 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
I20260806 00:55:44.174808 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:55:44.181066 22293 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:55:44.181782 22293 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:55:44.188661 22293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3d3563e89b148d5bcf823a6c2c8c1a1: Generated new TSK 0
I20260806 00:55:44.188838 22293 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:55:44.228777 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 22184
2026-08-06T00:55:44Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1552 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:55:44 dist-test-slave-44d2 krb5kdc[22312](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:55:44 dist-test-slave-44d2 krb5kdc[22312](info): set up 2 sockets
Aug 06 00:55:44 dist-test-slave-44d2 krb5kdc[22312](info): commencing operation
krb5kdc: starting...
W20260806 00:55:45.454030 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:55:45 dist-test-slave-44d2 krb5kdc[22312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:55:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:55:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:55:45.583667 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:39239
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:39239
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:55:45.666481 22328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:45.666735 22328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:45.666774 22328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:45.667919 22328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:55:45.667990 22328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:45.668013 22328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:45.668033 22328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:55:45.668059 22328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:55:45.670186 22328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:39239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:39239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:45.670470 22328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:45.670702 22328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:45.676085 22339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:45.676074 22328 server_base.cc:1034] running on GCE node
W20260806 00:55:45.676231 22335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:45.676056 22336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:45.676635 22328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:45.676967 22328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:45.678133 22328 hybrid_clock.cc:648] HybridClock initialized: now 1785977745678127 us; error 54 us; skew 500 ppm
Aug 06 00:55:45 dist-test-slave-44d2 krb5kdc[22312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977745, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:45.684238 22328 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:55:45.684772 22328 webserver.cc:460] Webserver started at http://127.3.98.190:45945/ using document root <none> and password file <none>
I20260806 00:55:45.685011 22328 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:45.685081 22328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:45.685235 22328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:55:45.686311 22328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "33f2a3ba1c0842eebf682929367b84ea"
format_stamp: "Formatted at 2026-08-06 00:55:45 on dist-test-slave-44d2"
server_key: "69ae23896a578c6a8f19258566735e2b"
server_key_iv: "13fde737e4166b5a0466748cac4d4bf4"
server_key_version: "encryptionkey@0"
I20260806 00:55:45.686692 22328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "33f2a3ba1c0842eebf682929367b84ea"
format_stamp: "Formatted at 2026-08-06 00:55:45 on dist-test-slave-44d2"
server_key: "69ae23896a578c6a8f19258566735e2b"
server_key_iv: "13fde737e4166b5a0466748cac4d4bf4"
server_key_version: "encryptionkey@0"
I20260806 00:55:45.688071 22328 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260806 00:55:45.689003 22348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:45.689183 22328 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:45.689303 22328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "33f2a3ba1c0842eebf682929367b84ea"
format_stamp: "Formatted at 2026-08-06 00:55:45 on dist-test-slave-44d2"
server_key: "69ae23896a578c6a8f19258566735e2b"
server_key_iv: "13fde737e4166b5a0466748cac4d4bf4"
server_key_version: "encryptionkey@0"
I20260806 00:55:45.689401 22328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:45.702852 22328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:45.705401 22328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:45.705583 22328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:45.710032 22328 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:39239
I20260806 00:55:45.710091 22423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:39239 every 8 connection(s)
I20260806 00:55:45.710482 22328 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:55:45.711509 22424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:45.713835 22424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Bootstrap starting.
I20260806 00:55:45.714427 22424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:45.714735 22424 log.cc:824] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:45.715508 22424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: No bootstrap required, opened a new log
I20260806 00:55:45.717137 22424 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } }
I20260806 00:55:45.717273 22424 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:45.717295 22424 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33f2a3ba1c0842eebf682929367b84ea, State: Initialized, Role: FOLLOWER
I20260806 00:55:45.717464 22424 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } }
I20260806 00:55:45.717528 22424 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:55:45.717549 22424 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:55:45.717620 22424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:45.718442 22424 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } }
I20260806 00:55:45.718554 22424 leader_election.cc:302] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33f2a3ba1c0842eebf682929367b84ea; no voters:
I20260806 00:55:45.718739 22424 leader_election.cc:288] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:55:45.718825 22428 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:55:45.718977 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 22328
I20260806 00:55:45.719008 22428 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 1 LEADER]: Becoming Leader. State: Replica: 33f2a3ba1c0842eebf682929367b84ea, State: Running, Role: LEADER
I20260806 00:55:45.719125 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:55:45.719110 22428 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } }
I20260806 00:55:45.719019 22424 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:55:45.719380 3466 external_mini_cluster.cc:1428] Setting key 438409a3407da640a5330faf4c597401
I20260806 00:55:45.719426 22429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33f2a3ba1c0842eebf682929367b84ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } } }
I20260806 00:55:45.719540 22429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:45.719689 22430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33f2a3ba1c0842eebf682929367b84ea. Latest consensus state: current_term: 1 leader_uuid: "33f2a3ba1c0842eebf682929367b84ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } } }
I20260806 00:55:45.719751 22430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:45.720422 22434 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:55:45.721032 22434 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:55:45.722659 22434 catalog_manager.cc:1347] Generated new cluster ID: 1d11ff09b3b441b1aa1281f8150733fb
I20260806 00:55:45.722714 22434 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:55:45 dist-test-slave-44d2 krb5kdc[22312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:45.731537 22443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:45.720104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40576 (local address 127.3.98.190:39239)
0806 00:55:45.720293 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:45.720302 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:45.720335 (+ 33us) server_negotiation.cc:407] Connection header received
0806 00:55:45.720457 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:45.720464 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:45.720549 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:45.720695 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:45.721601 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:45.722936 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:45.723992 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:45.724641 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:45.724777 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:45.727578 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:45.727582 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:45.727582 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:45.727594 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:45.729687 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:45.730117 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:45.730120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:45.730120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:45.730252 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:45.730485 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:45.730486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:45.730486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:45.730852 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:45.731004 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:45.731165 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 00:55:45.731303 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":73,"threads_started":1}
I20260806 00:55:45.733131 22434 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:55:45.733839 22434 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:55:45.737056 22434 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Generated new TSK 0
I20260806 00:55:45.737237 22434 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:55:45.767926 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:39239
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:55:45.852900 22458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:45.853101 22458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:45.853124 22458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:45.854278 22458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:45.854321 22458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:45.854347 22458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:55:45.855947 22458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:39239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:45.856199 22458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:45.856439 22458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:45.861589 22472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:45.861598 22469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:45.861748 22458 server_base.cc:1034] running on GCE node
W20260806 00:55:45.861598 22467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:45.862056 22458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:45.862278 22458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:45.863420 22458 hybrid_clock.cc:648] HybridClock initialized: now 1785977745863397 us; error 44 us; skew 500 ppm
Aug 06 00:55:45 dist-test-slave-44d2 krb5kdc[22312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977745, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:45.866189 22458 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:55:45.866628 22458 webserver.cc:460] Webserver started at http://127.3.98.129:41571/ using document root <none> and password file <none>
I20260806 00:55:45.866845 22458 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:45.866894 22458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:45.866994 22458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:55:45.868062 22458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "e4b40eb70d674562aca68b9e19d9c335"
format_stamp: "Formatted at 2026-08-06 00:55:45 on dist-test-slave-44d2"
server_key: "431d389725afd8cc119089dcea453c17"
server_key_iv: "f5464abb8a0f2175cefdf020b5bac49d"
server_key_version: "encryptionkey@0"
I20260806 00:55:45.868418 22458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "e4b40eb70d674562aca68b9e19d9c335"
format_stamp: "Formatted at 2026-08-06 00:55:45 on dist-test-slave-44d2"
server_key: "431d389725afd8cc119089dcea453c17"
server_key_iv: "f5464abb8a0f2175cefdf020b5bac49d"
server_key_version: "encryptionkey@0"
I20260806 00:55:45.869964 22458 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:55:45.870819 22479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:45.871007 22458 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:45.871107 22458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "e4b40eb70d674562aca68b9e19d9c335"
format_stamp: "Formatted at 2026-08-06 00:55:45 on dist-test-slave-44d2"
server_key: "431d389725afd8cc119089dcea453c17"
server_key_iv: "f5464abb8a0f2175cefdf020b5bac49d"
server_key_version: "encryptionkey@0"
I20260806 00:55:45.871170 22458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:45.880534 22458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:45.882781 22458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:45.882894 22458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:45.883080 22458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:45.883411 22458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:55:45.883471 22458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:45.883512 22458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:55:45.883540 22458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:45.889361 22458 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:39245
I20260806 00:55:45.889401 22643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:39245 every 8 connection(s)
I20260806 00:55:45.889745 22458 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:55:45.893386 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 22458
I20260806 00:55:45.893561 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:55:45.893761 3466 external_mini_cluster.cc:1428] Setting key 693712bd0f85f2e63bbaa3f6c06f163d
Aug 06 00:55:45 dist-test-slave-44d2 krb5kdc[22312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977745, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:45.900588 22443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:45.890552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:46685 (local address 127.3.98.190:39239)
0806 00:55:45.890620 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:45.890622 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:45.890876 (+ 254us) server_negotiation.cc:407] Connection header received
0806 00:55:45.891438 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:45.891440 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:45.891458 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:45.891514 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:45.892633 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:45.893160 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:45.894539 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:45.894878 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:45.894949 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:45.897562 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:45.897563 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:45.897564 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:45.897572 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:45.899024 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:45.899467 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:45.899468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:45.899469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:45.899537 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:45.899824 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:45.899825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:45.899826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:45.899946 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:45.900022 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:45.900330 (+ 308us) server_negotiation.cc:299] Negotiation successful
0806 00:55:45.900437 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 00:55:45.900712 22646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:45.890549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:46685)
0806 00:55:45.890753 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:45.890790 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:45.891314 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:45.891605 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:45.891609 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:45.892208 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:45.892454 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:45.892458 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:45.893269 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:45.893270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:45.894417 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:45.894421 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:45.894974 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:45.894974 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:45.895095 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:45.895847 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:45.895856 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:45.897449 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:45.899142 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:45.899150 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:45.899153 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:45.899383 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:45.899627 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:45.899628 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:45.899629 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:45.899745 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:45.900028 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:45.900036 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:45.900183 (+ 147us) client_negotiation.cc:769] Sending connection context
0806 00:55:45.900291 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 00:55:45.900457 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":110,"threads_started":1}
I20260806 00:55:45.901180 22644 heartbeater.cc:347] Connected to a master server at 127.3.98.190:39239
I20260806 00:55:45.901283 22644 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:45.901491 22644 heartbeater.cc:511] Master 127.3.98.190:39239 requested a full tablet report, sending...
I20260806 00:55:45.902024 22368 ts_manager.cc:194] Registered new tserver with Master: e4b40eb70d674562aca68b9e19d9c335 (127.3.98.129:39245)
I20260806 00:55:45.902671 22368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:46685
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:55:45.923370 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:39239
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:55:46.007757 22651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:46.007958 22651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:46.007982 22651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:46.009161 22651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:46.009203 22651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:46.009229 22651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:55:46.010625 22651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:39239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:46.010812 22651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:46.010987 22651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:46.016141 22660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:46.016160 22659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:46.016331 22651 server_base.cc:1034] running on GCE node
W20260806 00:55:46.016160 22663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:46.016602 22651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:46.016870 22651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:46.018040 22651 hybrid_clock.cc:648] HybridClock initialized: now 1785977746018019 us; error 37 us; skew 500 ppm
Aug 06 00:55:46 dist-test-slave-44d2 krb5kdc[22312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977746, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:46.020812 22651 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:55:46.021201 22651 webserver.cc:460] Webserver started at http://127.3.98.130:42167/ using document root <none> and password file <none>
I20260806 00:55:46.021441 22651 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:46.021498 22651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:46.021595 22651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:55:46.022639 22651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "6ea0c83f0e6744dba477597671a63c6a"
format_stamp: "Formatted at 2026-08-06 00:55:46 on dist-test-slave-44d2"
server_key: "1653e2ef62682772acac3555341a68b9"
server_key_iv: "59e44a263fe256743556f12e7c5fb8f4"
server_key_version: "encryptionkey@0"
I20260806 00:55:46.022938 22651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "6ea0c83f0e6744dba477597671a63c6a"
format_stamp: "Formatted at 2026-08-06 00:55:46 on dist-test-slave-44d2"
server_key: "1653e2ef62682772acac3555341a68b9"
server_key_iv: "59e44a263fe256743556f12e7c5fb8f4"
server_key_version: "encryptionkey@0"
I20260806 00:55:46.024222 22651 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 00:55:46.025096 22670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:46.025322 22651 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:46.025470 22651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "6ea0c83f0e6744dba477597671a63c6a"
format_stamp: "Formatted at 2026-08-06 00:55:46 on dist-test-slave-44d2"
server_key: "1653e2ef62682772acac3555341a68b9"
server_key_iv: "59e44a263fe256743556f12e7c5fb8f4"
server_key_version: "encryptionkey@0"
I20260806 00:55:46.025594 22651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:46.045603 22651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:46.048398 22651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:46.048557 22651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:46.048906 22651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:46.049263 22651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:55:46.049329 22651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:46.049368 22651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:55:46.049422 22651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:46.055994 22651 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:40569
I20260806 00:55:46.056066 22832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:40569 every 8 connection(s)
I20260806 00:55:46.056459 22651 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:55:46.059378 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 22651
I20260806 00:55:46.059499 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:55:46.059705 3466 external_mini_cluster.cc:1428] Setting key 3c79c8c548420d5886861f7f1e304293
Aug 06 00:55:46 dist-test-slave-44d2 krb5kdc[22312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977746, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:46.066936 22443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.057352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:49865 (local address 127.3.98.190:39239)
0806 00:55:46.057495 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:46.057498 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:46.057641 (+ 143us) server_negotiation.cc:407] Connection header received
0806 00:55:46.058124 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:46.058126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:46.058137 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:46.058195 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:46.059132 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.059892 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.061061 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.061423 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.061511 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.063816 (+ 2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:46.063818 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:46.063819 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:46.063826 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:46.065398 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:46.065856 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:46.065857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:46.065858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:46.065921 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:46.066213 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:46.066214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:46.066215 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:46.066338 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:46.066419 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:46.066725 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 00:55:46.066816 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260806 00:55:46.067132 22835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.057307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:49865)
0806 00:55:46.057491 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:46.057531 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:46.058018 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:46.058250 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:46.058253 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:46.058831 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:46.059027 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.059031 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.059990 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.059991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.060962 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.060965 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.061530 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.061531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.061659 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.062225 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:46.062235 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:46.063712 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:46.065489 (+ 1777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:46.065498 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:46.065500 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:46.065750 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:46.065998 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:46.065999 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:46.065999 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:46.066131 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:46.066411 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:46.066419 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:46.066576 (+ 157us) client_negotiation.cc:769] Sending connection context
0806 00:55:46.066702 (+ 126us) client_negotiation.cc:240] Negotiation successful
0806 00:55:46.066874 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":118,"threads_started":1}
I20260806 00:55:46.067683 22833 heartbeater.cc:347] Connected to a master server at 127.3.98.190:39239
I20260806 00:55:46.067826 22833 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:46.068061 22833 heartbeater.cc:511] Master 127.3.98.190:39239 requested a full tablet report, sending...
I20260806 00:55:46.068536 22368 ts_manager.cc:194] Registered new tserver with Master: 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569)
I20260806 00:55:46.069110 22368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:49865
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:55:46.092475 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:39239
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:55:46.181835 22839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:46.182049 22839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:46.182073 22839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:46.183279 22839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:46.183326 22839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:46.183352 22839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:55:46.184794 22839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:39239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:46.185000 22839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:46.185187 22839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:46.190480 22844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:46.190476 22848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:46.190563 22839 server_base.cc:1034] running on GCE node
W20260806 00:55:46.190511 22846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:46.190915 22839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:46.191200 22839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:46.192444 22839 hybrid_clock.cc:648] HybridClock initialized: now 1785977746192427 us; error 27 us; skew 500 ppm
Aug 06 00:55:46 dist-test-slave-44d2 krb5kdc[22312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977746, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:46.195202 22839 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:55:46.195678 22839 webserver.cc:460] Webserver started at http://127.3.98.131:43711/ using document root <none> and password file <none>
I20260806 00:55:46.195922 22839 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:46.195999 22839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:46.196159 22839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:55:46.197280 22839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "c54df34107b7420b95c8bce391769aeb"
format_stamp: "Formatted at 2026-08-06 00:55:46 on dist-test-slave-44d2"
server_key: "45dc71e0cb6e9b8f13f44b60d5453384"
server_key_iv: "bd5f32e4e2f43a8c56f5870f34fd5b29"
server_key_version: "encryptionkey@0"
I20260806 00:55:46.197649 22839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "c54df34107b7420b95c8bce391769aeb"
format_stamp: "Formatted at 2026-08-06 00:55:46 on dist-test-slave-44d2"
server_key: "45dc71e0cb6e9b8f13f44b60d5453384"
server_key_iv: "bd5f32e4e2f43a8c56f5870f34fd5b29"
server_key_version: "encryptionkey@0"
I20260806 00:55:46.199036 22839 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 00:55:46.199741 22863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:46.199920 22839 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:55:46.200028 22839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "c54df34107b7420b95c8bce391769aeb"
format_stamp: "Formatted at 2026-08-06 00:55:46 on dist-test-slave-44d2"
server_key: "45dc71e0cb6e9b8f13f44b60d5453384"
server_key_iv: "bd5f32e4e2f43a8c56f5870f34fd5b29"
server_key_version: "encryptionkey@0"
I20260806 00:55:46.200102 22839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:46.211831 22839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:46.214733 22839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:46.214920 22839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:46.215179 22839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:46.215559 22839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:55:46.215621 22839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:46.215667 22839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:55:46.215698 22839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:46.222712 22839 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:39647
I20260806 00:55:46.222754 23017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:39647 every 8 connection(s)
I20260806 00:55:46.223131 22839 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:55:46.228358 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 22839
I20260806 00:55:46.228472 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:55:46.228739 3466 external_mini_cluster.cc:1428] Setting key 6ff65bcae144b1a539de614aff6f19ae
Aug 06 00:55:46 dist-test-slave-44d2 krb5kdc[22312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977746, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:46.233438 22443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.223940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:58365 (local address 127.3.98.190:39239)
0806 00:55:46.223987 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:46.223990 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:46.224199 (+ 209us) server_negotiation.cc:407] Connection header received
0806 00:55:46.224810 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:46.224812 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:46.224826 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:46.224881 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:46.225867 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.226372 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.227403 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.227644 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.227730 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.230281 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:46.230283 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:46.230283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:46.230291 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:46.232177 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:46.232611 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:46.232612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:46.232613 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:46.232673 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:46.232909 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:46.232910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:46.232911 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:46.233025 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:46.233083 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:46.233279 (+ 196us) server_negotiation.cc:299] Negotiation successful
0806 00:55:46.233344 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 00:55:46.233573 23023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.223902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:58365)
0806 00:55:46.224071 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:46.224108 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:46.224698 (+ 590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:46.224960 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:46.224964 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:46.225551 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:46.225749 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.225754 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.226479 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.226482 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.227302 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.227305 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.227739 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.227740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.227869 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.228424 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:46.228438 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:46.230156 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:46.232254 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:46.232261 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:46.232263 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:46.232520 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:46.232735 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:46.232736 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:46.232736 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:46.232840 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:46.233078 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:46.233081 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:46.233189 (+ 108us) client_negotiation.cc:769] Sending connection context
0806 00:55:46.233258 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 00:55:46.233376 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":72,"threads_started":1}
I20260806 00:55:46.234066 23018 heartbeater.cc:347] Connected to a master server at 127.3.98.190:39239
I20260806 00:55:46.234153 23018 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:46.234292 23018 heartbeater.cc:511] Master 127.3.98.190:39239 requested a full tablet report, sending...
I20260806 00:55:46.234611 22368 ts_manager.cc:194] Registered new tserver with Master: c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647)
I20260806 00:55:46.235021 22368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:58365
I20260806 00:55:46.240741 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:55:46.248718 22443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.242188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40586 (local address 127.3.98.190:39239)
0806 00:55:46.242263 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:46.242266 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:46.242386 (+ 120us) server_negotiation.cc:407] Connection header received
0806 00:55:46.242467 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:46.242468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:46.242478 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:46.242550 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:46.243190 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.243662 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.244407 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.244684 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.244772 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.246119 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:46.246120 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:46.246121 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:46.246128 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:46.247303 (+ 1175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:46.247725 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:46.247727 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:46.247727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:46.247797 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:46.248030 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:46.248031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:46.248032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:46.248201 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:46.248322 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:46.248509 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 00:55:46.248605 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 00:55:46.250257 22368 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:55:46.251852 22368 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:55:46.259225 23038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.254416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:39647 (local address 127.0.0.1:35270)
0806 00:55:46.254659 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:46.254702 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:46.254801 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:46.255405 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:46.255406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:46.255409 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:46.255458 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.255460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.256808 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.256809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.258184 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.258188 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.258937 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.258938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.259001 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.259005 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:55:46.259102 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 00:55:46.259143 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":61,"thread_start_us":74,"threads_started":1}
I20260806 00:55:46.259254 23042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.254506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35270 (local address 127.3.98.131:39647)
0806 00:55:46.255235 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:46.255240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:46.255252 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:55:46.255288 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:46.255290 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:46.255306 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:46.255394 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:46.255546 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.256699 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.258257 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.258814 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.258929 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.258999 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:46.259120 (+ 121us) server_negotiation.cc:299] Negotiation successful
0806 00:55:46.259167 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":689,"thread_start_us":113,"threads_started":1}
I20260806 00:55:46.259466 23044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.254658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:39245 (local address 127.0.0.1:46562)
0806 00:55:46.254912 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:46.254923 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:46.254970 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:46.255606 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:46.255607 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:46.255609 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:46.255648 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.255649 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.256856 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.256857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.257829 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.257833 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.258842 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.258843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.258943 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.258959 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 00:55:46.259038 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 00:55:46.259101 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":82,"threads_started":1}
I20260806 00:55:46.259593 23037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.254417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:40569 (local address 127.0.0.1:45308)
0806 00:55:46.254793 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:46.254805 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:46.254870 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:46.255190 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:46.255193 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:46.255195 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:46.255265 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.255267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.256408 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.256409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.257913 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.257916 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.259180 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.259181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.259244 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.259249 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:55:46.259446 (+ 197us) client_negotiation.cc:240] Negotiation successful
0806 00:55:46.259493 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":7,"thread_start_us":82,"threads_started":1}
I20260806 00:55:46.259891 23043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.254643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45308 (local address 127.3.98.130:40569)
0806 00:55:46.254842 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:46.254848 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:46.254860 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:55:46.254987 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:46.254991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:46.255010 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:46.255099 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:46.255350 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.256288 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.258017 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.258740 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.258822 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.258884 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:46.259706 (+ 822us) server_negotiation.cc:299] Negotiation successful
0806 00:55:46.259793 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":100,"threads_started":1}
I20260806 00:55:46.260193 22930 tablet_service.cc:1467] Processing CreateTablet for tablet cca8c775591344068472700ddaff9928 (DEFAULT_TABLE table=test-table [id=6d8e5b787a784de2ae67e43f98f795ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:55:46.260610 23045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.254983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46562 (local address 127.3.98.129:39245)
0806 00:55:46.255415 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:46.255419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:46.255429 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:55:46.255467 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:46.255469 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:46.255485 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:46.255609 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:46.255699 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.256765 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.257927 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.258740 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.258822 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.258884 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:46.259067 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 00:55:46.259119 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":94,"threads_started":1}
I20260806 00:55:46.260648 22930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cca8c775591344068472700ddaff9928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:46.260598 22735 tablet_service.cc:1467] Processing CreateTablet for tablet cca8c775591344068472700ddaff9928 (DEFAULT_TABLE table=test-table [id=6d8e5b787a784de2ae67e43f98f795ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:55:46.260924 22735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cca8c775591344068472700ddaff9928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:46.264182 23046 tablet_bootstrap.cc:492] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a: Bootstrap starting.
I20260806 00:55:46.264668 23047 tablet_bootstrap.cc:492] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb: Bootstrap starting.
I20260806 00:55:46.264703 22551 tablet_service.cc:1467] Processing CreateTablet for tablet cca8c775591344068472700ddaff9928 (DEFAULT_TABLE table=test-table [id=6d8e5b787a784de2ae67e43f98f795ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:55:46.265053 22551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cca8c775591344068472700ddaff9928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:46.265101 23046 tablet_bootstrap.cc:654] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:46.265413 23047 tablet_bootstrap.cc:654] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:46.265760 23046 log.cc:824] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:46.266089 23047 log.cc:824] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:46.266868 23046 tablet_bootstrap.cc:492] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a: No bootstrap required, opened a new log
I20260806 00:55:46.266956 23046 ts_tablet_manager.cc:1397] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 00:55:46.268173 23052 tablet_bootstrap.cc:492] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Bootstrap starting.
I20260806 00:55:46.268826 23052 tablet_bootstrap.cc:654] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:46.268958 23047 tablet_bootstrap.cc:492] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb: No bootstrap required, opened a new log
I20260806 00:55:46.269042 23047 ts_tablet_manager.cc:1397] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 00:55:46.268996 23046 raft_consensus.cc:348] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:46.269196 23046 raft_consensus.cc:374] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:46.269244 23046 raft_consensus.cc:729] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ea0c83f0e6744dba477597671a63c6a, State: Initialized, Role: FOLLOWER
I20260806 00:55:46.269382 23046 consensus_queue.cc:260] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:46.269446 23052 log.cc:824] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:46.269686 23046 ts_tablet_manager.cc:1428] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:55:46.269704 22833 heartbeater.cc:503] Master 127.3.98.190:39239 was elected leader, sending a full tablet report...
I20260806 00:55:46.270432 23052 tablet_bootstrap.cc:492] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: No bootstrap required, opened a new log
I20260806 00:55:46.270576 23052 ts_tablet_manager.cc:1397] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:55:46.271126 23047 raft_consensus.cc:348] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:46.271317 23047 raft_consensus.cc:374] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:46.271358 23047 raft_consensus.cc:729] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54df34107b7420b95c8bce391769aeb, State: Initialized, Role: FOLLOWER
I20260806 00:55:46.271481 23047 consensus_queue.cc:260] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:46.271808 23047 ts_tablet_manager.cc:1428] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:55:46.271831 23018 heartbeater.cc:503] Master 127.3.98.190:39239 was elected leader, sending a full tablet report...
I20260806 00:55:46.272727 23052 raft_consensus.cc:348] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:46.272905 23052 raft_consensus.cc:374] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:46.272948 23052 raft_consensus.cc:729] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b40eb70d674562aca68b9e19d9c335, State: Initialized, Role: FOLLOWER
I20260806 00:55:46.273082 23052 consensus_queue.cc:260] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:46.273319 23052 ts_tablet_manager.cc:1428] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:55:46.273398 22644 heartbeater.cc:503] Master 127.3.98.190:39239 was elected leader, sending a full tablet report...
W20260806 00:55:46.307163 22834 tablet.cc:2369] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 00:55:46.390535 22645 tablet.cc:2369] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:55:46.436122 23053 raft_consensus.cc:482] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:55:46.436302 23053 raft_consensus.cc:504] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:46.436776 23053 leader_election.cc:288] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647), e4b40eb70d674562aca68b9e19d9c335 (127.3.98.129:39245)
I20260806 00:55:46.440778 23042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.437078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:51389 (local address 127.3.98.131:39647)
0806 00:55:46.437145 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:46.437147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:46.437160 (+ 13us) server_negotiation.cc:407] Connection header received
0806 00:55:46.437193 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:46.437194 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:46.437205 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:46.437332 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:46.437530 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.438309 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.439768 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.440369 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.440517 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.440527 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:46.440663 (+ 136us) server_negotiation.cc:299] Negotiation successful
0806 00:55:46.440708 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 00:55:46.440798 23045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.437249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:40163 (local address 127.3.98.129:39245)
0806 00:55:46.437342 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:46.437345 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:46.437472 (+ 127us) server_negotiation.cc:407] Connection header received
0806 00:55:46.437534 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:46.437535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:46.437547 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:46.437601 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:46.437741 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.438432 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.439768 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.440373 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.440456 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.440467 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:46.440692 (+ 225us) server_negotiation.cc:299] Negotiation successful
0806 00:55:46.440734 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 00:55:46.440784 22835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.436975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:39647 (local address 127.3.98.130:51389)
0806 00:55:46.437037 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:46.437051 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:46.437098 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:46.437365 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:46.437367 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:46.437369 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:46.437452 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.437454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.438392 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.438392 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.439640 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.439643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.440468 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.440469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.440584 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.440586 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:55:46.440643 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 00:55:46.440691 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":7}
I20260806 00:55:46.440791 23060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.437119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:39245 (local address 127.3.98.130:40163)
0806 00:55:46.437395 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:46.437406 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:46.437465 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:46.437618 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:46.437618 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:46.437620 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:46.437673 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.437674 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.438508 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.438508 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.439640 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.439643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.440468 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.440469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.440575 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.440579 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:55:46.440683 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 00:55:46.440712 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":7,"thread_start_us":188,"threads_started":1}
I20260806 00:55:46.441248 22579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cca8c775591344068472700ddaff9928" candidate_uuid: "6ea0c83f0e6744dba477597671a63c6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b40eb70d674562aca68b9e19d9c335" is_pre_election: true
I20260806 00:55:46.441335 22957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cca8c775591344068472700ddaff9928" candidate_uuid: "6ea0c83f0e6744dba477597671a63c6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54df34107b7420b95c8bce391769aeb" is_pre_election: true
I20260806 00:55:46.441432 22579 raft_consensus.cc:2454] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ea0c83f0e6744dba477597671a63c6a in term 0.
I20260806 00:55:46.441453 22957 raft_consensus.cc:2454] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ea0c83f0e6744dba477597671a63c6a in term 0.
I20260806 00:55:46.441664 22679 leader_election.cc:302] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ea0c83f0e6744dba477597671a63c6a, e4b40eb70d674562aca68b9e19d9c335; no voters:
I20260806 00:55:46.441839 23053 raft_consensus.cc:2781] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:55:46.441910 23053 raft_consensus.cc:482] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:55:46.441927 23053 raft_consensus.cc:3037] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:46.442777 23053 raft_consensus.cc:504] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:46.442893 23053 leader_election.cc:288] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [CANDIDATE]: Term 1 election: Requested vote from peers c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647), e4b40eb70d674562aca68b9e19d9c335 (127.3.98.129:39245)
I20260806 00:55:46.443120 22957 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cca8c775591344068472700ddaff9928" candidate_uuid: "6ea0c83f0e6744dba477597671a63c6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c54df34107b7420b95c8bce391769aeb"
I20260806 00:55:46.443159 22579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cca8c775591344068472700ddaff9928" candidate_uuid: "6ea0c83f0e6744dba477597671a63c6a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b40eb70d674562aca68b9e19d9c335"
I20260806 00:55:46.443199 22957 raft_consensus.cc:3037] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:46.443254 22579 raft_consensus.cc:3037] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:46.443930 22957 raft_consensus.cc:2454] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ea0c83f0e6744dba477597671a63c6a in term 1.
I20260806 00:55:46.444131 22579 raft_consensus.cc:2454] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ea0c83f0e6744dba477597671a63c6a in term 1.
I20260806 00:55:46.444129 22679 leader_election.cc:302] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ea0c83f0e6744dba477597671a63c6a, c54df34107b7420b95c8bce391769aeb; no voters:
I20260806 00:55:46.444263 23053 raft_consensus.cc:2781] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:55:46.444501 23053 raft_consensus.cc:686] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [term 1 LEADER]: Becoming Leader. State: Replica: 6ea0c83f0e6744dba477597671a63c6a, State: Running, Role: LEADER
I20260806 00:55:46.444613 23053 consensus_queue.cc:237] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:46.445585 22368 catalog_manager.cc:5495] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130). New cstate: current_term: 1 leader_uuid: "6ea0c83f0e6744dba477597671a63c6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } health_report { overall_health: UNKNOWN } } }
W20260806 00:55:46.473807 23021 tablet.cc:2369] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:55:46.486400 23043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.483959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45314 (local address 127.3.98.130:40569)
0806 00:55:46.484029 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:46.484031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:46.484056 (+ 25us) server_negotiation.cc:407] Connection header received
0806 00:55:46.484103 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:46.484104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:46.484130 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:46.484217 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:55:46.484373 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.484931 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.485695 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.485903 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.485987 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.486100 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:55:46.486203 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:55:46.486267 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:46.486303 (+ 36us) server_negotiation.cc:299] Negotiation successful
0806 00:55:46.486323 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 00:55:46.488444 22579 raft_consensus.cc:1261] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Refusing update from remote peer 6ea0c83f0e6744dba477597671a63c6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:55:46.488444 22957 raft_consensus.cc:1261] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb [term 1 FOLLOWER]: Refusing update from remote peer 6ea0c83f0e6744dba477597671a63c6a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:55:46.488889 23061 consensus_queue.cc:1035] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:55:46.489077 23053 consensus_queue.cc:1035] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:55:46.491806 23065 mvcc.cc:205] Tried to move back new op lower bound from 7315364849613193216 to 7315364849437687808. Current Snapshot: MvccSnapshot[applied={T|T < 7315364849613193216}]
I20260806 00:55:46.491824 23067 mvcc.cc:205] Tried to move back new op lower bound from 7315364849613193216 to 7315364849437687808. Current Snapshot: MvccSnapshot[applied={T|T < 7315364849613193216}]
I20260806 00:55:46.492214 23064 mvcc.cc:205] Tried to move back new op lower bound from 7315364849613193216 to 7315364849437687808. Current Snapshot: MvccSnapshot[applied={T|T < 7315364849613193216}]
I20260806 00:55:46.494313 22366 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:55:46.494416 22366 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:55:46.495245 22366 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Sending DeleteTablet for 3 replicas of tablet cca8c775591344068472700ddaff9928
I20260806 00:55:46.495617 22551 tablet_service.cc:1514] Processing DeleteTablet for tablet cca8c775591344068472700ddaff9928 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:55:46 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:46562
I20260806 00:55:46.495626 22735 tablet_service.cc:1514] Processing DeleteTablet for tablet cca8c775591344068472700ddaff9928 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:55:46 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:45308
I20260806 00:55:46.495623 22930 tablet_service.cc:1514] Processing DeleteTablet for tablet cca8c775591344068472700ddaff9928 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:55:46 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:35270
I20260806 00:55:46.495930 23077 tablet_replica.cc:330] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a: stopping tablet replica
I20260806 00:55:46.495935 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 22458
I20260806 00:55:46.496033 23077 raft_consensus.cc:2229] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:55:46.496240 23077 raft_consensus.cc:2258] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:55:46.499398 23077 ts_tablet_manager.cc:1905] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:55:46.501271 23077 ts_tablet_manager.cc:1918] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:55:46.501420 23077 log.cc:1196] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/cca8c775591344068472700ddaff9928
I20260806 00:55:46.501813 23077 ts_tablet_manager.cc:1939] T cca8c775591344068472700ddaff9928 P 6ea0c83f0e6744dba477597671a63c6a: Deleting consensus metadata
I20260806 00:55:46.502298 22350 catalog_manager.cc:4841] TS 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569): tablet cca8c775591344068472700ddaff9928 (table test-table [id=6d8e5b787a784de2ae67e43f98f795ac]) successfully deleted
I20260806 00:55:46.505105 23076 tablet_replica.cc:330] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb: stopping tablet replica
I20260806 00:55:46.505252 23076 raft_consensus.cc:2229] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:55:46.505374 23076 raft_consensus.cc:2258] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:55:46.505812 23076 ts_tablet_manager.cc:1905] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:55:46.507213 23076 ts_tablet_manager.cc:1918] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:55:46.507305 23076 log.cc:1196] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/cca8c775591344068472700ddaff9928
I20260806 00:55:46.507602 23076 ts_tablet_manager.cc:1939] T cca8c775591344068472700ddaff9928 P c54df34107b7420b95c8bce391769aeb: Deleting consensus metadata
I20260806 00:55:46.508044 22353 catalog_manager.cc:4841] TS c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647): tablet cca8c775591344068472700ddaff9928 (table test-table [id=6d8e5b787a784de2ae67e43f98f795ac]) successfully deleted
W20260806 00:55:46.510288 22353 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:39245 (error 108)
I20260806 00:55:46.510494 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 22651
I20260806 00:55:46.512573 23037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.512355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:39245 (local address 127.0.0.1:46570)
0806 00:55:46.512436 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:46.512530 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:39245: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 00:55:46.513813 22353 catalog_manager.cc:4584] TS e4b40eb70d674562aca68b9e19d9c335 (127.3.98.129:39245): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cca8c775591344068472700ddaff9928: Network error: Client connection negotiation failed: client connection to 127.3.98.129:39245: connect: Connection refused (error 111)
I20260806 00:55:46.519446 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 22839
I20260806 00:55:46.526533 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 22328
I20260806 00:55:46.536219 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:39239
--webserver_interface=127.3.98.190
--webserver_port=45945
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:39239
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:55:46.620051 23083 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:46.620319 23083 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:46.620358 23083 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:46.621523 23083 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:55:46.621606 23083 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:46.621632 23083 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:46.621652 23083 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:55:46.621685 23083 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:55:46.623178 23083 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:39239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:39239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=45945
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23083
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:46.623471 23083 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:46.623715 23083 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:46.633575 23094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:46.633555 23096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:46.633531 23098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:46.633852 23083 server_base.cc:1034] running on GCE node
I20260806 00:55:46.634182 23083 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:46.634517 23083 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:46.635700 23083 hybrid_clock.cc:648] HybridClock initialized: now 1785977746635682 us; error 44 us; skew 500 ppm
Aug 06 00:55:46 dist-test-slave-44d2 krb5kdc[22312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977746, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:46.638331 23083 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:55:46.638775 23083 webserver.cc:460] Webserver started at http://127.3.98.190:45945/ using document root <none> and password file <none>
I20260806 00:55:46.639034 23083 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:46.639122 23083 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:46.640579 23083 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 00:55:46.641394 23107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:46.641582 23083 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:55:46.641671 23083 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "33f2a3ba1c0842eebf682929367b84ea"
format_stamp: "Formatted at 2026-08-06 00:55:45 on dist-test-slave-44d2"
server_key: "69ae23896a578c6a8f19258566735e2b"
server_key_iv: "13fde737e4166b5a0466748cac4d4bf4"
server_key_version: "encryptionkey@0"
I20260806 00:55:46.642119 23083 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:46.654357 23083 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:46.656742 23083 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:46.656860 23083 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:46.660903 23083 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:39239
I20260806 00:55:46.660974 23178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:39239 every 8 connection(s)
I20260806 00:55:46.661329 23083 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:55:46.661665 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 23083
I20260806 00:55:46.661968 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:39245
--local_ip_for_outbound_sockets=127.3.98.129
--tserver_master_addrs=127.3.98.190:39239
--webserver_port=41571
--webserver_interface=127.3.98.129
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:55:46.663071 23179 sys_catalog.cc:263] Verifying existing consensus state
I20260806 00:55:46.663937 23179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Bootstrap starting.
I20260806 00:55:46.673547 23179 log.cc:824] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:46.675685 23179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 00:55:46.676028 23179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Bootstrap complete.
I20260806 00:55:46.678694 23179 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } }
I20260806 00:55:46.678925 23179 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33f2a3ba1c0842eebf682929367b84ea, State: Initialized, Role: FOLLOWER
I20260806 00:55:46.679111 23179 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } }
I20260806 00:55:46.679174 23179 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:55:46.679227 23179 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:55:46.679276 23179 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 1 FOLLOWER]: Advancing to term 2
I20260806 00:55:46.680315 23179 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } }
I20260806 00:55:46.680403 23179 leader_election.cc:302] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33f2a3ba1c0842eebf682929367b84ea; no voters:
I20260806 00:55:46.680682 23179 leader_election.cc:288] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 00:55:46.680718 23189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 2 FOLLOWER]: Leader election won for term 2
I20260806 00:55:46.680835 23189 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 2 LEADER]: Becoming Leader. State: Replica: 33f2a3ba1c0842eebf682929367b84ea, State: Running, Role: LEADER
I20260806 00:55:46.680972 23179 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:55:46.681015 23189 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } }
I20260806 00:55:46.681388 23190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "33f2a3ba1c0842eebf682929367b84ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } } }
I20260806 00:55:46.681386 23189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33f2a3ba1c0842eebf682929367b84ea. Latest consensus state: current_term: 2 leader_uuid: "33f2a3ba1c0842eebf682929367b84ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } } }
I20260806 00:55:46.681572 23189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:46.681483 23190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:46.682266 23203 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:55:46.682986 23203 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:55:46.683066 23203 catalog_manager.cc:1259] Loaded cluster ID: 1d11ff09b3b441b1aa1281f8150733fb
I20260806 00:55:46.683131 23203 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:55:46.683337 23203 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 00:55:46.686081 23203 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 00:55:46.688382 23203 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:55:46.688606 23203 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Loaded TSK: 0
I20260806 00:55:46.688824 23203 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 00:55:46.753330 23183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:46.753563 23183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:46.753602 23183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:46.754748 23183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:46.754814 23183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:46.754859 23183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:55:46.756342 23183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:39245
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=41571
--tserver_master_addrs=127.3.98.190:39239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:46.756642 23183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:46.756882 23183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:46.762059 23230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:46.762084 23229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:46.762275 23234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:46.762334 23183 server_base.cc:1034] running on GCE node
I20260806 00:55:46.762547 23183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:46.762831 23183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:46.763994 23183 hybrid_clock.cc:648] HybridClock initialized: now 1785977746763978 us; error 39 us; skew 500 ppm
Aug 06 00:55:46 dist-test-slave-44d2 krb5kdc[22312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977746, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:46.766779 23183 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:55:46.767199 23183 webserver.cc:460] Webserver started at http://127.3.98.129:41571/ using document root <none> and password file <none>
I20260806 00:55:46.767443 23183 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:46.767530 23183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:46.769121 23183 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:55:46.769879 23242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:46.770076 23183 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:46.770179 23183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "e4b40eb70d674562aca68b9e19d9c335"
format_stamp: "Formatted at 2026-08-06 00:55:45 on dist-test-slave-44d2"
server_key: "431d389725afd8cc119089dcea453c17"
server_key_iv: "f5464abb8a0f2175cefdf020b5bac49d"
server_key_version: "encryptionkey@0"
I20260806 00:55:46.770596 23183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:46.781987 23183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:46.784341 23183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:46.784518 23183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:46.784792 23183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:46.785301 23253 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 00:55:46.786815 23183 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 00:55:46.786868 23183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 00:55:46.786902 23183 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 00:55:46.787593 23183 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 00:55:46.787642 23183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260806 00:55:46.787691 23253 tablet_bootstrap.cc:492] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Bootstrap starting.
I20260806 00:55:46.795792 23183 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:39245
I20260806 00:55:46.796342 23183 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:55:46.798389 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 23183
I20260806 00:55:46.798707 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:40569
--local_ip_for_outbound_sockets=127.3.98.130
--tserver_master_addrs=127.3.98.190:39239
--webserver_port=42167
--webserver_interface=127.3.98.130
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:55:46.799896 23253 log.cc:824] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:46.800145 23398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:39245 every 8 connection(s)
I20260806 00:55:46.803350 23253 tablet_bootstrap.cc:492] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 00:55:46.803759 23253 tablet_bootstrap.cc:492] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Bootstrap complete.
I20260806 00:55:46.805209 23253 ts_tablet_manager.cc:1397] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.013s
I20260806 00:55:46.806746 23253 raft_consensus.cc:348] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:46.807165 23253 raft_consensus.cc:729] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b40eb70d674562aca68b9e19d9c335, State: Initialized, Role: FOLLOWER
I20260806 00:55:46.807394 23253 consensus_queue.cc:260] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:46.808143 23253 ts_tablet_manager.cc:1428] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
Aug 06 00:55:46 dist-test-slave-44d2 krb5kdc[22312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977746, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:46.814721 23404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.797115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:60083)
0806 00:55:46.797394 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:46.797435 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:46.798058 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:46.801702 (+ 3644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:46.801707 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:46.802178 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:46.802465 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.802472 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.804831 (+ 2359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.804832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.806325 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.806329 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.807313 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.807314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.807484 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.808168 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:46.808180 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:46.810227 (+ 2047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:46.812768 (+ 2541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:46.812773 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:46.812776 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:46.813080 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:46.813402 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:46.813403 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:46.813403 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:46.813548 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:46.814044 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:46.814051 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:46.814212 (+ 161us) client_negotiation.cc:769] Sending connection context
0806 00:55:46.814323 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 00:55:46.814496 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":104,"threads_started":1}
I20260806 00:55:46.814736 23405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.797673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:60083 (local address 127.3.98.190:39239)
0806 00:55:46.801182 (+ 3509us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:46.801193 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:46.801236 (+ 43us) server_negotiation.cc:407] Connection header received
0806 00:55:46.801391 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:46.801398 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:46.801459 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:46.802693 (+ 1234us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:46.802840 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.804685 (+ 1845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.806460 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.807187 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.807831 (+ 644us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.810365 (+ 2534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:46.810371 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:46.810371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:46.810384 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:46.812677 (+ 2293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:46.813182 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:46.813185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:46.813186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:46.813312 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:46.813634 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:46.813635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:46.813635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:46.813942 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:46.814035 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:46.814397 (+ 362us) server_negotiation.cc:299] Negotiation successful
0806 00:55:46.814537 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3444,"thread_start_us":89,"threads_started":1}
I20260806 00:55:46.815495 23400 heartbeater.cc:347] Connected to a master server at 127.3.98.190:39239
I20260806 00:55:46.815610 23400 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:46.815807 23400 heartbeater.cc:511] Master 127.3.98.190:39239 requested a full tablet report, sending...
I20260806 00:55:46.816632 23128 ts_manager.cc:194] Registered new tserver with Master: e4b40eb70d674562aca68b9e19d9c335 (127.3.98.129:39245)
I20260806 00:55:46.817835 23128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:60083
I20260806 00:55:46.818881 23400 heartbeater.cc:503] Master 127.3.98.190:39239 was elected leader, sending a full tablet report...
I20260806 00:55:46.824877 23410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.817298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:39245 (local address 127.0.0.1:46580)
0806 00:55:46.820603 (+ 3305us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:46.820644 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:46.820725 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:46.820942 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:46.820946 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:46.820948 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:46.821050 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.821052 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.822309 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.822310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.823570 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.823574 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.824476 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.824494 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.824619 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.824639 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 00:55:46.824731 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 00:55:46.824802 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3271,"thread_start_us":121,"threads_started":1}
I20260806 00:55:46.824877 23411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.818126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46580 (local address 127.3.98.129:39245)
0806 00:55:46.818294 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:46.818299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:46.820721 (+ 2422us) server_negotiation.cc:407] Connection header received
0806 00:55:46.820809 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:46.820811 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:46.820828 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:46.820927 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:46.821122 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.822210 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.823665 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.824374 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.824455 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.824541 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:46.824770 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 00:55:46.824812 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":88,"threads_started":1}
I20260806 00:55:46.825667 23305 tablet_service.cc:1514] Processing DeleteTablet for tablet cca8c775591344068472700ddaff9928 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:55:46 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:46580
I20260806 00:55:46.826272 23412 tablet_replica.cc:330] stopping tablet replica
I20260806 00:55:46.826380 23412 raft_consensus.cc:2229] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:55:46.826447 23412 raft_consensus.cc:2258] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:55:46.826761 23412 ts_tablet_manager.cc:1905] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:55:46.829062 23412 ts_tablet_manager.cc:1918] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:55:46.829144 23412 log.cc:1196] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal/wals/cca8c775591344068472700ddaff9928
I20260806 00:55:46.829427 23412 ts_tablet_manager.cc:1939] T cca8c775591344068472700ddaff9928 P e4b40eb70d674562aca68b9e19d9c335: Deleting consensus metadata
I20260806 00:55:46.829908 23111 catalog_manager.cc:4841] TS e4b40eb70d674562aca68b9e19d9c335 (127.3.98.129:39245): tablet cca8c775591344068472700ddaff9928 (table test-table [id=6d8e5b787a784de2ae67e43f98f795ac]) successfully deleted
W20260806 00:55:46.891579 23407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:46.891814 23407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:46.891863 23407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:46.893034 23407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:46.893101 23407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:46.893146 23407 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:55:46.894587 23407 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:40569
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=42167
--tserver_master_addrs=127.3.98.190:39239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:46.894842 23407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:46.895083 23407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:46.900161 23418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:46.900168 23421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:46.900168 23419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:46.900256 23407 server_base.cc:1034] running on GCE node
I20260806 00:55:46.900630 23407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:46.900974 23407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:46.902136 23407 hybrid_clock.cc:648] HybridClock initialized: now 1785977746902112 us; error 42 us; skew 500 ppm
Aug 06 00:55:46 dist-test-slave-44d2 krb5kdc[22312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977746, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:46.904937 23407 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:55:46.905438 23407 webserver.cc:460] Webserver started at http://127.3.98.130:42167/ using document root <none> and password file <none>
I20260806 00:55:46.905692 23407 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:46.905778 23407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:46.907155 23407 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:46.907784 23430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:46.908010 23407 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 00:55:46.908104 23407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "6ea0c83f0e6744dba477597671a63c6a"
format_stamp: "Formatted at 2026-08-06 00:55:46 on dist-test-slave-44d2"
server_key: "1653e2ef62682772acac3555341a68b9"
server_key_iv: "59e44a263fe256743556f12e7c5fb8f4"
server_key_version: "encryptionkey@0"
I20260806 00:55:46.908463 23407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:46.922297 23407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:46.924736 23407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:46.924911 23407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:46.925165 23407 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:46.925475 23407 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:55:46.925529 23407 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:46.925571 23407 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:55:46.925601 23407 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:46.931425 23407 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:40569
I20260806 00:55:46.931478 23597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:40569 every 8 connection(s)
I20260806 00:55:46.931816 23407 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:55:46.935700 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 23407
I20260806 00:55:46.936015 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:39647
--local_ip_for_outbound_sockets=127.3.98.131
--tserver_master_addrs=127.3.98.190:39239
--webserver_port=43711
--webserver_interface=127.3.98.131
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 00:55:46 dist-test-slave-44d2 krb5kdc[22312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977746, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:46.942377 23405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.932571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:49811 (local address 127.3.98.190:39239)
0806 00:55:46.932647 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:46.932649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:46.932854 (+ 205us) server_negotiation.cc:407] Connection header received
0806 00:55:46.933393 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:46.933395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:46.933409 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:46.933531 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:46.934526 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.935031 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.936444 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.936712 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.936773 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.939142 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:46.939144 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:46.939144 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:46.939151 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:46.940754 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:46.941293 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:46.941294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:46.941294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:46.941350 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:46.941700 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:46.941700 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:46.941701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:46.941817 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:46.941869 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:46.942234 (+ 365us) server_negotiation.cc:299] Negotiation successful
0806 00:55:46.942310 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 00:55:46.942710 23603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:46.932587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:49811)
0806 00:55:46.932734 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:46.932770 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:46.933283 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:46.933621 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:46.933625 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:46.934226 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:46.934419 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.934424 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.935134 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.935135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.936336 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:46.936339 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:46.936799 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:46.936800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:46.936960 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:46.937455 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:46.937465 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:46.939052 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:46.940860 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:46.940868 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:46.940871 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:46.941209 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:46.941445 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:46.941446 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:46.941447 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:46.941616 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:46.941887 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:46.941895 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:46.942075 (+ 180us) client_negotiation.cc:769] Sending connection context
0806 00:55:46.942210 (+ 135us) client_negotiation.cc:240] Negotiation successful
0806 00:55:46.942405 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":73,"threads_started":1}
I20260806 00:55:46.943298 23601 heartbeater.cc:347] Connected to a master server at 127.3.98.190:39239
I20260806 00:55:46.943415 23601 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:46.943645 23601 heartbeater.cc:511] Master 127.3.98.190:39239 requested a full tablet report, sending...
I20260806 00:55:46.944108 23128 ts_manager.cc:194] Registered new tserver with Master: 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569)
I20260806 00:55:46.944573 23128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:49811
W20260806 00:55:47.022833 23604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:47.023056 23604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:47.023080 23604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:47.024245 23604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:47.024289 23604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:47.024343 23604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:55:47.025852 23604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:39647
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=43711
--tserver_master_addrs=127.3.98.190:39239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:47.026096 23604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:47.026329 23604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:47.031559 23616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:47.031623 23604 server_base.cc:1034] running on GCE node
W20260806 00:55:47.031534 23617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:47.031548 23619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:47.031946 23604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:47.032239 23604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:47.033409 23604 hybrid_clock.cc:648] HybridClock initialized: now 1785977747033402 us; error 39 us; skew 500 ppm
Aug 06 00:55:47 dist-test-slave-44d2 krb5kdc[22312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977747, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:47.035938 23604 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:55:47.036434 23604 webserver.cc:460] Webserver started at http://127.3.98.131:43711/ using document root <none> and password file <none>
I20260806 00:55:47.036720 23604 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:47.036808 23604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:47.038208 23604 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:55:47.038820 23627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:47.039001 23604 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:55:47.039103 23604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "c54df34107b7420b95c8bce391769aeb"
format_stamp: "Formatted at 2026-08-06 00:55:46 on dist-test-slave-44d2"
server_key: "45dc71e0cb6e9b8f13f44b60d5453384"
server_key_iv: "bd5f32e4e2f43a8c56f5870f34fd5b29"
server_key_version: "encryptionkey@0"
I20260806 00:55:47.039489 23604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:47.051813 23604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:47.053718 23604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:47.053892 23604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:47.054126 23604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:47.054463 23604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:55:47.054504 23604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:47.054525 23604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:55:47.054538 23604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:47.060527 23604 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:39647
I20260806 00:55:47.060583 23782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:39647 every 8 connection(s)
I20260806 00:55:47.060963 23604 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:55:47.062450 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 23604
Aug 06 00:55:47 dist-test-slave-44d2 krb5kdc[22312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977747, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:55:47.070086 23790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.062844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40600 (local address 127.3.98.190:39239)
0806 00:55:47.063090 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:47.063092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:47.063098 (+ 6us) server_negotiation.cc:407] Connection header received
0806 00:55:47.063117 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:47.063118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:47.063128 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:47.063206 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:47.063799 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.064314 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.065128 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.065328 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.065406 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:47.066780 (+ 1374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:47.066782 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:47.066782 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:47.066789 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:47.068578 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:47.069217 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:47.069218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:47.069218 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:47.069278 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:47.069509 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:47.069511 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:47.069511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:47.069635 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:47.069831 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:47.069877 (+ 46us) server_negotiation.cc:299] Negotiation successful
0806 00:55:47.069953 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":54,"threads_started":1}
I20260806 00:55:47.071250 23405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.061754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:55405 (local address 127.3.98.190:39239)
0806 00:55:47.061803 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:47.061805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:47.062017 (+ 212us) server_negotiation.cc:407] Connection header received
0806 00:55:47.062668 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:47.062670 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:47.062684 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:47.062767 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:47.063868 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.064365 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.065408 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.065618 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.065695 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:47.068027 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:47.068029 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:47.068030 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:47.068037 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:47.069661 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:47.070180 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:47.070182 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:47.070182 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:47.070254 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:47.070618 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:47.070619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:47.070619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:47.070751 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:47.070822 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:47.071126 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 00:55:47.071190 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 00:55:47.071419 23788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.061718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:55405)
0806 00:55:47.061888 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.061931 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:47.062553 (+ 622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:47.062927 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:47.062932 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:47.063567 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:47.063763 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:47.063767 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.064504 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.064506 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:47.065315 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:47.065317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.065719 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.065720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:47.065851 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:47.066294 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:47.066302 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:47.067904 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:47.069779 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:47.069786 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:47.069788 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:47.070085 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:47.070373 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:47.070374 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:47.070374 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:47.070545 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:47.070832 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:47.070839 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:47.070999 (+ 160us) client_negotiation.cc:769] Sending connection context
0806 00:55:47.071088 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 00:55:47.071211 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":101,"threads_started":1}
I20260806 00:55:47.071926 23783 heartbeater.cc:347] Connected to a master server at 127.3.98.190:39239
I20260806 00:55:47.072038 23783 heartbeater.cc:464] Registering TS with master...
I20260806 00:55:47.072225 23783 heartbeater.cc:511] Master 127.3.98.190:39239 requested a full tablet report, sending...
I20260806 00:55:47.072662 23128 ts_manager.cc:194] Registered new tserver with Master: c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647)
I20260806 00:55:47.073143 23128 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:55405
I20260806 00:55:47.081739 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:55:47.085762 23405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.082142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40614 (local address 127.3.98.190:39239)
0806 00:55:47.082226 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:47.082228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:47.082421 (+ 193us) server_negotiation.cc:407] Connection header received
0806 00:55:47.082472 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:47.082473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:47.082507 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:47.082572 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:55:47.082658 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.083235 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.084457 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.084821 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.084927 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:47.085156 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:55:47.085307 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:55:47.085445 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:47.085498 (+ 53us) server_negotiation.cc:299] Negotiation successful
0806 00:55:47.085522 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 00:55:47.086028 23128 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:40614:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:55:47.087939 23128 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:55:47.091090 23305 tablet_service.cc:1467] Processing CreateTablet for tablet 41b758f21e8b4c9bbb5a05b2216e83b2 (DEFAULT_TABLE table=test-table [id=265d3f4bfe914455aa36aa1f2e4a19e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:55:47.091338 23305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41b758f21e8b4c9bbb5a05b2216e83b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:47.093119 23253 tablet_bootstrap.cc:492] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335: Bootstrap starting.
I20260806 00:55:47.093474 23253 tablet_bootstrap.cc:654] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:47.094065 23253 tablet_bootstrap.cc:492] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335: No bootstrap required, opened a new log
I20260806 00:55:47.094120 23253 ts_tablet_manager.cc:1397] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 00:55:47.094228 23253 raft_consensus.cc:348] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:47.094293 23253 raft_consensus.cc:374] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:47.094316 23794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.090526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:40569 (local address 127.0.0.1:45322)
0806 00:55:47.090882 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.090894 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:47.090956 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:47.091336 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:47.091337 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:47.091339 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:47.091387 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:47.091389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.092218 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.092219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:47.093018 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:47.093020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.094040 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.094041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:47.094110 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:47.094115 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:55:47.094193 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 00:55:47.094236 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":122,"threads_started":1}
I20260806 00:55:47.094337 23253 raft_consensus.cc:729] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b40eb70d674562aca68b9e19d9c335, State: Initialized, Role: FOLLOWER
I20260806 00:55:47.094390 23253 consensus_queue.cc:260] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:47.094345 23795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.090645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45322 (local address 127.3.98.130:40569)
0806 00:55:47.091179 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:47.091184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:47.091193 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:55:47.091236 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:47.091238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:47.091249 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:47.091338 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:47.091444 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.092114 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.093138 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.093944 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.094025 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:47.094108 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:47.094204 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 00:55:47.094258 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":131,"threads_started":1}
I20260806 00:55:47.094504 23253 ts_tablet_manager.cc:1428] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:47.094743 23410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.090458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:39647 (local address 127.0.0.1:35282)
0806 00:55:47.090693 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.090704 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:47.090748 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:47.091026 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:47.091027 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:47.091029 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:47.091070 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:47.091071 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.092373 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.092374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:47.093461 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:47.093466 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.094512 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.094513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:47.094573 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:47.094576 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:55:47.094632 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 00:55:47.094673 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":14}
I20260806 00:55:47.095072 23796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.090677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35282 (local address 127.3.98.131:39647)
0806 00:55:47.090880 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:47.090884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:47.090892 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:55:47.090924 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:47.090925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:47.090939 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:47.091031 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:47.091161 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.092216 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.093649 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.094421 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.094505 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:47.094562 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:47.094931 (+ 369us) server_negotiation.cc:299] Negotiation successful
0806 00:55:47.094978 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":95,"threads_started":1}
I20260806 00:55:47.095109 23495 tablet_service.cc:1467] Processing CreateTablet for tablet 41b758f21e8b4c9bbb5a05b2216e83b2 (DEFAULT_TABLE table=test-table [id=265d3f4bfe914455aa36aa1f2e4a19e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:55:47.095528 23495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41b758f21e8b4c9bbb5a05b2216e83b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:47.095793 23691 tablet_service.cc:1467] Processing CreateTablet for tablet 41b758f21e8b4c9bbb5a05b2216e83b2 (DEFAULT_TABLE table=test-table [id=265d3f4bfe914455aa36aa1f2e4a19e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:55:47.096125 23691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41b758f21e8b4c9bbb5a05b2216e83b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:55:47.098845 23799 tablet_bootstrap.cc:492] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a: Bootstrap starting.
I20260806 00:55:47.099038 23802 tablet_bootstrap.cc:492] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb: Bootstrap starting.
I20260806 00:55:47.099581 23799 tablet_bootstrap.cc:654] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:47.099684 23802 tablet_bootstrap.cc:654] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb: Neither blocks nor log segments found. Creating new log.
I20260806 00:55:47.100260 23799 log.cc:824] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:47.100313 23802 log.cc:824] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:47.101212 23799 tablet_bootstrap.cc:492] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a: No bootstrap required, opened a new log
I20260806 00:55:47.101228 23802 tablet_bootstrap.cc:492] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb: No bootstrap required, opened a new log
I20260806 00:55:47.101289 23802 ts_tablet_manager.cc:1397] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260806 00:55:47.101289 23799 ts_tablet_manager.cc:1397] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 00:55:47.103276 23799 raft_consensus.cc:348] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:47.103276 23802 raft_consensus.cc:348] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:47.103464 23802 raft_consensus.cc:374] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:47.103464 23799 raft_consensus.cc:374] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:55:47.103505 23799 raft_consensus.cc:729] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ea0c83f0e6744dba477597671a63c6a, State: Initialized, Role: FOLLOWER
I20260806 00:55:47.103505 23802 raft_consensus.cc:729] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c54df34107b7420b95c8bce391769aeb, State: Initialized, Role: FOLLOWER
I20260806 00:55:47.103632 23802 consensus_queue.cc:260] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:47.103657 23799 consensus_queue.cc:260] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:47.103940 23802 ts_tablet_manager.cc:1428] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260806 00:55:47.103940 23799 ts_tablet_manager.cc:1428] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 00:55:47.103974 23783 heartbeater.cc:503] Master 127.3.98.190:39239 was elected leader, sending a full tablet report...
I20260806 00:55:47.104079 23601 heartbeater.cc:503] Master 127.3.98.190:39239 was elected leader, sending a full tablet report...
W20260806 00:55:47.182416 23602 tablet.cc:2369] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:55:47.187220 23807 raft_consensus.cc:482] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:55:47.187395 23807 raft_consensus.cc:504] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:47.187894 23807 leader_election.cc:288] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569), e4b40eb70d674562aca68b9e19d9c335 (127.3.98.129:39245)
I20260806 00:55:47.191316 23411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.188323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:33285 (local address 127.3.98.129:39245)
0806 00:55:47.188375 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:47.188377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:47.188386 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:55:47.188416 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:47.188417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:47.188428 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:47.188520 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:47.188756 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.189450 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.190491 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.190940 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.191026 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:47.191035 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:47.191198 (+ 163us) server_negotiation.cc:299] Negotiation successful
0806 00:55:47.191239 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 00:55:47.191366 23809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.188081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:39245 (local address 127.3.98.131:33285)
0806 00:55:47.188257 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.188266 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:47.188315 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:47.188574 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:47.188575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:47.188577 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:47.188665 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:47.188668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.189530 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.189531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:47.190370 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:47.190372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.191024 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.191025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:47.191112 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:47.191118 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 00:55:47.191185 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 00:55:47.191235 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":18,"thread_start_us":97,"threads_started":1}
I20260806 00:55:47.191771 23788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.188067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:40569 (local address 127.3.98.131:40799)
0806 00:55:47.188120 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.188134 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:47.188195 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:47.188374 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:47.188375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:47.188377 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:55:47.188473 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:47.188476 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.189374 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.189375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:47.190703 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:47.190706 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.191493 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.191494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:47.191596 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:47.191600 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:55:47.191653 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 00:55:47.191697 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":1}
I20260806 00:55:47.191847 23333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b758f21e8b4c9bbb5a05b2216e83b2" candidate_uuid: "c54df34107b7420b95c8bce391769aeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b40eb70d674562aca68b9e19d9c335" is_pre_election: true
I20260806 00:55:47.192050 23333 raft_consensus.cc:2454] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54df34107b7420b95c8bce391769aeb in term 0.
I20260806 00:55:47.192073 23795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.188191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:40799 (local address 127.3.98.130:40569)
0806 00:55:47.188244 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:47.188246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:47.188256 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:55:47.188289 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:47.188290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:47.188300 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:47.188355 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:55:47.188567 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.189298 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.190801 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.191362 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.191435 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:47.191445 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:47.191963 (+ 518us) server_negotiation.cc:299] Negotiation successful
0806 00:55:47.192008 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 00:55:47.192399 23522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b758f21e8b4c9bbb5a05b2216e83b2" candidate_uuid: "c54df34107b7420b95c8bce391769aeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea0c83f0e6744dba477597671a63c6a" is_pre_election: true
I20260806 00:55:47.192588 23522 raft_consensus.cc:2454] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c54df34107b7420b95c8bce391769aeb in term 0.
I20260806 00:55:47.192829 23631 leader_election.cc:302] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c54df34107b7420b95c8bce391769aeb, e4b40eb70d674562aca68b9e19d9c335; no voters:
I20260806 00:55:47.192992 23807 raft_consensus.cc:2781] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:55:47.193077 23807 raft_consensus.cc:482] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:55:47.193118 23807 raft_consensus.cc:3037] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:47.193845 23807 raft_consensus.cc:504] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:47.194005 23807 leader_election.cc:288] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [CANDIDATE]: Term 1 election: Requested vote from peers 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569), e4b40eb70d674562aca68b9e19d9c335 (127.3.98.129:39245)
I20260806 00:55:47.194170 23522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b758f21e8b4c9bbb5a05b2216e83b2" candidate_uuid: "c54df34107b7420b95c8bce391769aeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea0c83f0e6744dba477597671a63c6a"
I20260806 00:55:47.194168 23333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41b758f21e8b4c9bbb5a05b2216e83b2" candidate_uuid: "c54df34107b7420b95c8bce391769aeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4b40eb70d674562aca68b9e19d9c335"
I20260806 00:55:47.194267 23522 raft_consensus.cc:3037] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:47.194268 23333 raft_consensus.cc:3037] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:55:47.195184 23522 raft_consensus.cc:2454] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54df34107b7420b95c8bce391769aeb in term 1.
I20260806 00:55:47.195351 23628 leader_election.cc:302] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ea0c83f0e6744dba477597671a63c6a, c54df34107b7420b95c8bce391769aeb; no voters:
I20260806 00:55:47.195431 23807 raft_consensus.cc:2781] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:55:47.195595 23807 raft_consensus.cc:686] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [term 1 LEADER]: Becoming Leader. State: Replica: c54df34107b7420b95c8bce391769aeb, State: Running, Role: LEADER
I20260806 00:55:47.195694 23807 consensus_queue.cc:237] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:47.195791 23333 raft_consensus.cc:2454] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c54df34107b7420b95c8bce391769aeb in term 1.
I20260806 00:55:47.196624 23127 catalog_manager.cc:5495] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb reported cstate change: term changed from 0 to 1, leader changed from <none> to c54df34107b7420b95c8bce391769aeb (127.3.98.131). New cstate: current_term: 1 leader_uuid: "c54df34107b7420b95c8bce391769aeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } health_report { overall_health: UNKNOWN } } }
I20260806 00:55:47.213089 23796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.210450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35288 (local address 127.3.98.131:39647)
0806 00:55:47.210532 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:47.210534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:47.210546 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:55:47.210624 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:47.210624 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:47.210641 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:47.210700 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:55:47.210794 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.211260 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.212207 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:47.212393 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:47.212444 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:47.212659 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:55:47.212759 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:55:47.212824 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:47.212938 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 00:55:47.212955 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 00:55:47.215003 23522 raft_consensus.cc:1261] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a [term 1 FOLLOWER]: Refusing update from remote peer c54df34107b7420b95c8bce391769aeb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:55:47.215009 23333 raft_consensus.cc:1261] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Refusing update from remote peer c54df34107b7420b95c8bce391769aeb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:55:47.215482 23810 consensus_queue.cc:1035] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:55:47.215634 23807 consensus_queue.cc:1035] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:55:47.218081 23814 mvcc.cc:205] Tried to move back new op lower bound from 7315364852589756416 to 7315364852514291712. Current Snapshot: MvccSnapshot[applied={T|T < 7315364852589756416}]
I20260806 00:55:47.218508 23818 mvcc.cc:205] Tried to move back new op lower bound from 7315364852589756416 to 7315364852514291712. Current Snapshot: MvccSnapshot[applied={T|T < 7315364852589756416}]
I20260806 00:55:47.220072 23815 mvcc.cc:205] Tried to move back new op lower bound from 7315364852589756416 to 7315364852514291712. Current Snapshot: MvccSnapshot[applied={T|T < 7315364852589756416 or (T in {7315364852589756416})}]
I20260806 00:55:47.220393 23127 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:40614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:55:47.220530 23127 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:40614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:55:47.221356 23127 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Sending DeleteTablet for 3 replicas of tablet 41b758f21e8b4c9bbb5a05b2216e83b2
I20260806 00:55:47.221657 23691 tablet_service.cc:1514] Processing DeleteTablet for tablet 41b758f21e8b4c9bbb5a05b2216e83b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:55:47 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:35282
I20260806 00:55:47.221705 23305 tablet_service.cc:1514] Processing DeleteTablet for tablet 41b758f21e8b4c9bbb5a05b2216e83b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:55:47 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:46580
I20260806 00:55:47.221709 23495 tablet_service.cc:1514] Processing DeleteTablet for tablet 41b758f21e8b4c9bbb5a05b2216e83b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:55:47 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:45322
I20260806 00:55:47.221931 23831 tablet_replica.cc:330] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb: stopping tablet replica
I20260806 00:55:47.222034 23412 tablet_replica.cc:330] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335: stopping tablet replica
I20260806 00:55:47.222054 23831 raft_consensus.cc:2229] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:55:47.222103 23412 raft_consensus.cc:2229] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:55:47.222153 23831 raft_consensus.cc:2258] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:55:47.222173 23412 raft_consensus.cc:2258] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:55:47.222433 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 23183
I20260806 00:55:47.226938 23831 ts_tablet_manager.cc:1905] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:55:47.229682 23831 ts_tablet_manager.cc:1918] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:55:47.229817 23831 log.cc:1196] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/41b758f21e8b4c9bbb5a05b2216e83b2
I20260806 00:55:47.230319 23831 ts_tablet_manager.cc:1939] T 41b758f21e8b4c9bbb5a05b2216e83b2 P c54df34107b7420b95c8bce391769aeb: Deleting consensus metadata
I20260806 00:55:47.230957 23111 catalog_manager.cc:4841] TS c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647): tablet 41b758f21e8b4c9bbb5a05b2216e83b2 (table test-table [id=265d3f4bfe914455aa36aa1f2e4a19e4]) successfully deleted
I20260806 00:55:47.232651 23833 tablet_replica.cc:330] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a: stopping tablet replica
I20260806 00:55:47.232856 23833 raft_consensus.cc:2229] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:55:47.233035 23833 raft_consensus.cc:2258] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:55:47.234084 23833 ts_tablet_manager.cc:1905] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:55:47.235857 23833 ts_tablet_manager.cc:1918] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:55:47.235945 23833 log.cc:1196] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/41b758f21e8b4c9bbb5a05b2216e83b2
I20260806 00:55:47.236245 23833 ts_tablet_manager.cc:1939] T 41b758f21e8b4c9bbb5a05b2216e83b2 P 6ea0c83f0e6744dba477597671a63c6a: Deleting consensus metadata
I20260806 00:55:47.236965 23108 catalog_manager.cc:4841] TS 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569): tablet 41b758f21e8b4c9bbb5a05b2216e83b2 (table test-table [id=265d3f4bfe914455aa36aa1f2e4a19e4]) successfully deleted
W20260806 00:55:47.241204 23111 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:39245 (error 108)
I20260806 00:55:47.241631 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 23407
I20260806 00:55:47.243153 23410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.241774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:39245 (local address 127.0.0.1:46590)
0806 00:55:47.243070 (+ 1296us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.243115 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:39245: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1273}
W20260806 00:55:47.243367 23111 catalog_manager.cc:4584] TS e4b40eb70d674562aca68b9e19d9c335 (127.3.98.129:39245): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 41b758f21e8b4c9bbb5a05b2216e83b2: Network error: Client connection negotiation failed: client connection to 127.3.98.129:39245: connect: Connection refused (error 111)
I20260806 00:55:47.249630 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 23604
I20260806 00:55:47.260649 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 23083
I20260806 00:55:47.270557 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:39239
--webserver_interface=127.3.98.190
--webserver_port=45945
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:39239
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:55:47.354939 23836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:47.355192 23836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:47.355233 23836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:47.356356 23836 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:55:47.356426 23836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:47.356451 23836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:47.356470 23836 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:55:47.356491 23836 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:55:47.358007 23836 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:39239
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:39239
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=45945
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:47.358285 23836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:47.358515 23836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:47.363399 23845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:47.363438 23843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:47.363399 23842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:47.363756 23836 server_base.cc:1034] running on GCE node
I20260806 00:55:47.364073 23836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:47.364360 23836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:47.365530 23836 hybrid_clock.cc:648] HybridClock initialized: now 1785977747365546 us; error 58 us; skew 500 ppm
Aug 06 00:55:47 dist-test-slave-44d2 krb5kdc[22312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977747, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:47.368173 23836 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:55:47.368667 23836 webserver.cc:460] Webserver started at http://127.3.98.190:45945/ using document root <none> and password file <none>
I20260806 00:55:47.368870 23836 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:47.368911 23836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:47.370230 23836 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:47.371201 23860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:47.371392 23836 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:47.371495 23836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "33f2a3ba1c0842eebf682929367b84ea"
format_stamp: "Formatted at 2026-08-06 00:55:45 on dist-test-slave-44d2"
server_key: "69ae23896a578c6a8f19258566735e2b"
server_key_iv: "13fde737e4166b5a0466748cac4d4bf4"
server_key_version: "encryptionkey@0"
I20260806 00:55:47.371830 23836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:47.395135 23836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:47.397643 23836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:47.397814 23836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:47.402146 23836 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:39239
I20260806 00:55:47.402186 23936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:39239 every 8 connection(s)
I20260806 00:55:47.402575 23836 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:55:47.404192 23938 sys_catalog.cc:263] Verifying existing consensus state
I20260806 00:55:47.404930 23938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Bootstrap starting.
I20260806 00:55:47.406091 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 23836
I20260806 00:55:47.406419 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:39245
--local_ip_for_outbound_sockets=127.3.98.129
--tserver_master_addrs=127.3.98.190:39239
--webserver_port=41571
--webserver_interface=127.3.98.129
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:55:47.415191 23938 log.cc:824] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:47.417629 23938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 00:55:47.417964 23938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: Bootstrap complete.
I20260806 00:55:47.420277 23938 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } }
I20260806 00:55:47.420540 23938 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33f2a3ba1c0842eebf682929367b84ea, State: Initialized, Role: FOLLOWER
I20260806 00:55:47.420755 23938 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } }
I20260806 00:55:47.420856 23938 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:55:47.420912 23938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:55:47.420966 23938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 2 FOLLOWER]: Advancing to term 3
I20260806 00:55:47.422020 23938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } }
I20260806 00:55:47.422147 23938 leader_election.cc:302] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33f2a3ba1c0842eebf682929367b84ea; no voters:
I20260806 00:55:47.422358 23938 leader_election.cc:288] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 00:55:47.422394 23943 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 3 FOLLOWER]: Leader election won for term 3
I20260806 00:55:47.422513 23943 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [term 3 LEADER]: Becoming Leader. State: Replica: 33f2a3ba1c0842eebf682929367b84ea, State: Running, Role: LEADER
I20260806 00:55:47.422614 23943 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } }
I20260806 00:55:47.422641 23938 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:55:47.422909 23943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33f2a3ba1c0842eebf682929367b84ea. Latest consensus state: current_term: 3 leader_uuid: "33f2a3ba1c0842eebf682929367b84ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } } }
I20260806 00:55:47.422991 23943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:47.422915 23944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "33f2a3ba1c0842eebf682929367b84ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f2a3ba1c0842eebf682929367b84ea" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39239 } } }
I20260806 00:55:47.423141 23944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea [sys.catalog]: This master's current role is: LEADER
I20260806 00:55:47.424569 23960 catalog_manager.cc:1259] Loaded cluster ID: 1d11ff09b3b441b1aa1281f8150733fb
I20260806 00:55:47.424623 23960 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: loading cluster ID for follower catalog manager: success
W20260806 00:55:47.424939 23960 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 33f2a3ba1c0842eebf682929367b84ea: acquiring CA information for follower catalog manager: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
W20260806 00:55:47.424997 23960 catalog_manager.cc:873] Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO: failed to prepare follower catalog manager, will retry
I20260806 00:55:47.425032 23947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:55:47.425408 23947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:55:47.425508 23947 catalog_manager.cc:1259] Loaded cluster ID: 1d11ff09b3b441b1aa1281f8150733fb
I20260806 00:55:47.425550 23947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 00:55:47.425729 23947 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7efff8a699ad google::LogMessage::Fail() at ??:0
@ 0x7efff8a6c88a google::LogMessage::SendToLog() at ??:0
@ 0x7efff8a694de google::LogMessage::Flush() at ??:0
@ 0x7efff8a6aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f000098a0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f00009938b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7efffa9370d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7efffa92c954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7efffb7906db start_thread at ??:0
@ 0x7efff756761f clone at ??:0
W20260806 00:55:47.513130 23940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:47.513341 23940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:47.513367 23940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:47.514633 23940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:47.514678 23940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:47.514707 23940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:55:47.516332 23940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:39245
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=41571
--tserver_master_addrs=127.3.98.190:39239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:47.516623 23940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:47.516889 23940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:47.522367 23988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:47.522460 23989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:47.522624 23991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:47.522718 23940 server_base.cc:1034] running on GCE node
I20260806 00:55:47.523087 23940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:47.523461 23940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:47.524631 23940 hybrid_clock.cc:648] HybridClock initialized: now 1785977747524616 us; error 33 us; skew 500 ppm
Aug 06 00:55:47 dist-test-slave-44d2 krb5kdc[22312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977747, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:47.527377 23940 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:55:47.527904 23940 webserver.cc:460] Webserver started at http://127.3.98.129:41571/ using document root <none> and password file <none>
I20260806 00:55:47.528163 23940 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:47.528214 23940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:47.529732 23940 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:47.530516 24006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:47.530721 23940 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:47.530826 23940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "e4b40eb70d674562aca68b9e19d9c335"
format_stamp: "Formatted at 2026-08-06 00:55:45 on dist-test-slave-44d2"
server_key: "431d389725afd8cc119089dcea453c17"
server_key_iv: "f5464abb8a0f2175cefdf020b5bac49d"
server_key_version: "encryptionkey@0"
I20260806 00:55:47.531193 23940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:47.549587 23940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:47.552443 23940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:47.552732 23940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:47.553033 23940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:47.553639 24015 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 00:55:47.555816 23940 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 00:55:47.555941 23940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 00:55:47.556000 23940 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 00:55:47.556840 23940 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 00:55:47.556907 23940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:47.556986 24015 tablet_bootstrap.cc:492] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335: Bootstrap starting.
I20260806 00:55:47.565704 23940 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:39245
I20260806 00:55:47.565891 24166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:39245 every 8 connection(s)
I20260806 00:55:47.566213 23940 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:55:47.569023 24015 log.cc:824] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335: Log is configured to *not* fsync() on all Append() calls
I20260806 00:55:47.571990 24015 tablet_bootstrap.cc:492] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 00:55:47.572304 24015 tablet_bootstrap.cc:492] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335: Bootstrap complete.
I20260806 00:55:47.573503 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 23940
I20260806 00:55:47.573637 24015 ts_tablet_manager.cc:1397] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.008s
I20260806 00:55:47.573827 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:40569
--local_ip_for_outbound_sockets=127.3.98.130
--tserver_master_addrs=127.3.98.190:39239
--webserver_port=42167
--webserver_interface=127.3.98.130
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:55:47.575135 24015 raft_consensus.cc:348] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:47.575490 24015 raft_consensus.cc:729] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4b40eb70d674562aca68b9e19d9c335, State: Initialized, Role: FOLLOWER
I20260806 00:55:47.575659 24015 consensus_queue.cc:260] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:47.575968 24015 ts_tablet_manager.cc:1428] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335: Time spent starting tablet: real 0.002s user 0.001s sys 0.003s
W20260806 00:55:47.633085 24170 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:55:47.567021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:44475)
0806 00:55:47.567339 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.567382 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:47.567848 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:47.632842 (+ 64994us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":114,"threads_started":1}
W20260806 00:55:47.633397 24168 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:39239 (0 consecutive failures): Network error: Failed to ping master at 127.3.98.190:39239: Client connection negotiation failed: client connection to 127.3.98.190:39239: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 00:55:47.633793 24170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.633666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:38195)
0806 00:55:47.633726 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.633772 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 00:55:47.634198 24170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.634084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:51919)
0806 00:55:47.634135 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.634173 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 00:55:47.634336 24168 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 00:55:47.674492 24172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:47.674717 24172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:47.674744 24172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:47.675859 24172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:47.675896 24172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:47.675922 24172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:55:47.677452 24172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:40569
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=42167
--tserver_master_addrs=127.3.98.190:39239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:47.677659 24172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:47.677852 24172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:47.683158 24181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:47.683236 24172 server_base.cc:1034] running on GCE node
W20260806 00:55:47.683167 24180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:47.683157 24184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:47.683583 24172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:47.683843 24172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:47.685024 24172 hybrid_clock.cc:648] HybridClock initialized: now 1785977747685009 us; error 27 us; skew 500 ppm
Aug 06 00:55:47 dist-test-slave-44d2 krb5kdc[22312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977747, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:47.687665 24172 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:55:47.688102 24172 webserver.cc:460] Webserver started at http://127.3.98.130:42167/ using document root <none> and password file <none>
I20260806 00:55:47.688356 24172 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:47.688427 24172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:47.689808 24172 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:55:47.690439 24192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:47.690611 24172 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:55:47.690712 24172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "6ea0c83f0e6744dba477597671a63c6a"
format_stamp: "Formatted at 2026-08-06 00:55:46 on dist-test-slave-44d2"
server_key: "1653e2ef62682772acac3555341a68b9"
server_key_iv: "59e44a263fe256743556f12e7c5fb8f4"
server_key_version: "encryptionkey@0"
I20260806 00:55:47.691051 24172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:47.708989 24172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:47.711092 24172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:47.711279 24172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:47.711560 24172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:47.711900 24172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:55:47.711957 24172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:47.711994 24172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:55:47.712041 24172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:47.718431 24172 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:40569
I20260806 00:55:47.718484 24352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:40569 every 8 connection(s)
I20260806 00:55:47.718849 24172 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:55:47.719950 24355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.719555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:56449)
0806 00:55:47.719711 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.719788 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
W20260806 00:55:47.720391 24353 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:39239 (0 consecutive failures): Network error: Failed to ping master at 127.3.98.190:39239: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
I20260806 00:55:47.720707 24355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.720614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:39353)
0806 00:55:47.720661 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.720690 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 00:55:47.720988 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 24172
I20260806 00:55:47.721236 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:39647
--local_ip_for_outbound_sockets=127.3.98.131
--tserver_master_addrs=127.3.98.190:39239
--webserver_port=43711
--webserver_interface=127.3.98.131
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:55:47.722990 24355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.720984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:50683)
0806 00:55:47.722927 (+ 1943us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.722959 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1929,"mutex_wait_us":1912}
W20260806 00:55:47.723136 24353 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 00:55:47.805914 24356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:55:47.806129 24356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:55:47.806154 24356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:55:47.807312 24356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:55:47.807358 24356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:55:47.807384 24356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:55:47.808884 24356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:39647
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=43711
--tserver_master_addrs=127.3.98.190:39239
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:55:47.809150 24356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:55:47.809393 24356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:55:47.814803 24368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:55:47.814774 24366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:47.814817 24356 server_base.cc:1034] running on GCE node
W20260806 00:55:47.814782 24364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:55:47.815243 24356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:55:47.815448 24356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:55:47.816548 24356 hybrid_clock.cc:648] HybridClock initialized: now 1785977747816528 us; error 29 us; skew 500 ppm
Aug 06 00:55:47 dist-test-slave-44d2 krb5kdc[22312](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977747, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:55:47.819077 24356 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:55:47.819572 24356 webserver.cc:460] Webserver started at http://127.3.98.131:43711/ using document root <none> and password file <none>
I20260806 00:55:47.819813 24356 fs_manager.cc:359] Metadata directory not provided
I20260806 00:55:47.819896 24356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:55:47.821336 24356 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:47.821955 24380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:47.822155 24356 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:55:47.822264 24356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "c54df34107b7420b95c8bce391769aeb"
format_stamp: "Formatted at 2026-08-06 00:55:46 on dist-test-slave-44d2"
server_key: "45dc71e0cb6e9b8f13f44b60d5453384"
server_key_iv: "bd5f32e4e2f43a8c56f5870f34fd5b29"
server_key_version: "encryptionkey@0"
I20260806 00:55:47.822618 24356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:55:47.851491 24356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:55:47.853736 24356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:55:47.853911 24356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:55:47.854188 24356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:55:47.854537 24356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:55:47.854604 24356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:47.854643 24356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:55:47.854676 24356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:55:47.861944 24356 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:39647
I20260806 00:55:47.862000 24539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:39647 every 8 connection(s)
I20260806 00:55:47.862398 24356 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:55:47.863528 24542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.863129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:44469)
0806 00:55:47.863301 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.863379 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":85,"threads_started":1}
W20260806 00:55:47.863943 24540 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:39239 (0 consecutive failures): Network error: Failed to ping master at 127.3.98.190:39239: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
I20260806 00:55:47.864267 24542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.864174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:57853)
0806 00:55:47.864223 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.864250 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 00:55:47.864580 24542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:47.864472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:47169)
0806 00:55:47.864536 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:47.864558 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 00:55:47.864688 24540 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 00:55:47.867302 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 24356
I20260806 00:55:48.634984 24544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:48.634727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:60915)
0806 00:55:48.634865 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:48.634912 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":67,"threads_started":1}
I20260806 00:55:48.723627 24545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:48.723430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:52263)
0806 00:55:48.723548 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:48.723579 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":64,"threads_started":1}
I20260806 00:55:48.827270 24546 raft_consensus.cc:482] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:55:48.827399 24546 raft_consensus.cc:504] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:48.827839 24546 leader_election.cc:288] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647), 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569)
Aug 06 00:55:48 dist-test-slave-44d2 krb5kdc[22312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977747, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.131@KRBTEST.COM
Aug 06 00:55:48 dist-test-slave-44d2 krb5kdc[22312](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977747, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.130@KRBTEST.COM
I20260806 00:55:48.839411 24548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:48.828014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:40569 (local address 127.3.98.129:51155)
0806 00:55:48.828140 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:48.828152 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:48.828211 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:48.829126 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:48.829129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:48.829540 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:48.829758 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:48.829764 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:48.830933 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:48.830939 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:48.831754 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:48.831757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:48.832399 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:48.832400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:48.832554 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:48.833216 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:48.833226 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:48.835476 (+ 2250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:48.837844 (+ 2368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:48.837845 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:48.837846 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:48.838089 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:48.838379 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:48.838380 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:48.838380 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:48.838499 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:48.838950 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:48.838951 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:48.838989 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 00:55:48.839071 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 00:55:48.839301 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":11,"thread_start_us":55,"threads_started":1}
I20260806 00:55:48.839540 24544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:48.827983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:39647 (local address 127.3.98.129:37549)
0806 00:55:48.828032 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:48.828044 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:55:48.828127 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:55:48.829125 (+ 998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:55:48.829128 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:55:48.829538 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:55:48.829758 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:48.829764 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:48.830942 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:48.830943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:48.831754 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:55:48.831757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:55:48.832398 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:55:48.832399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:55:48.832555 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:48.833269 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:55:48.833274 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:55:48.835004 (+ 1730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:55:48.837537 (+ 2533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:48.837546 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:48.837549 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:48.837866 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:48.838169 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:55:48.838170 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:55:48.838170 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:55:48.838309 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:55:48.838809 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:55:48.838817 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:55:48.838972 (+ 155us) client_negotiation.cc:769] Sending connection context
0806 00:55:48.839117 (+ 145us) client_negotiation.cc:240] Negotiation successful
0806 00:55:48.839389 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":181}
I20260806 00:55:48.839466 24549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:48.828132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:37549 (local address 127.3.98.131:39647)
0806 00:55:48.828287 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:48.828301 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:48.828326 (+ 25us) server_negotiation.cc:407] Connection header received
0806 00:55:48.828855 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:48.828857 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:48.828915 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:48.829083 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:48.829907 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:48.830813 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:48.831862 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:48.832284 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:48.832411 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:48.835125 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:48.835130 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:48.835130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:48.835144 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:48.837409 (+ 2265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:48.837966 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:48.837969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:48.837970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:48.838088 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:48.838379 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:48.838380 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:48.838380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:48.838735 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:48.838799 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:48.839204 (+ 405us) server_negotiation.cc:299] Negotiation successful
0806 00:55:48.839335 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":58,"threads_started":1}
I20260806 00:55:48.839457 24550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:48.828186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:51155 (local address 127.3.98.130:40569)
0806 00:55:48.828367 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 00:55:48.828376 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:55:48.828405 (+ 29us) server_negotiation.cc:407] Connection header received
0806 00:55:48.828889 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:55:48.828891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:55:48.828932 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:55:48.829092 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:55:48.829895 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:48.830801 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:48.831853 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:55:48.832285 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:55:48.832434 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:55:48.835625 (+ 3191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:55:48.835631 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:55:48.835631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:55:48.835644 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:55:48.837754 (+ 2110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:48.838180 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:48.838183 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:48.838183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:48.838291 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:55:48.838591 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:55:48.838592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:55:48.838592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:55:48.838867 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:55:48.838955 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 00:55:48.839162 (+ 207us) server_negotiation.cc:299] Negotiation successful
0806 00:55:48.839332 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":95,"threads_started":1}
W20260806 00:55:48.840579 24011 leader_election.cc:341] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647): Not found: Tablet not found: 41b758f21e8b4c9bbb5a05b2216e83b2
W20260806 00:55:48.840860 24007 leader_election.cc:341] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569): Not found: Tablet not found: 41b758f21e8b4c9bbb5a05b2216e83b2
I20260806 00:55:48.840920 24007 leader_election.cc:302] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b40eb70d674562aca68b9e19d9c335; no voters: 6ea0c83f0e6744dba477597671a63c6a, c54df34107b7420b95c8bce391769aeb
I20260806 00:55:48.841040 24546 raft_consensus.cc:2726] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 00:55:48.865228 24551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:48.865011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:47677)
0806 00:55:48.865149 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:48.865193 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
I20260806 00:55:49.635767 24554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:49.635550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:54525)
0806 00:55:49.635686 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:49.635721 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260806 00:55:49.724292 24555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:49.724088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:55335)
0806 00:55:49.724215 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:49.724249 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":68,"threads_started":1}
I20260806 00:55:49.865899 24556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:49.865672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:48921)
0806 00:55:49.865823 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:49.865861 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":85,"threads_started":1}
I20260806 00:55:50.376154 24557 raft_consensus.cc:482] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:55:50.376291 24557 raft_consensus.cc:504] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:50.376564 24557 leader_election.cc:288] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647), 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569)
W20260806 00:55:50.377058 24011 leader_election.cc:341] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647): Not found: Tablet not found: 41b758f21e8b4c9bbb5a05b2216e83b2
W20260806 00:55:50.377151 24007 leader_election.cc:341] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569): Not found: Tablet not found: 41b758f21e8b4c9bbb5a05b2216e83b2
I20260806 00:55:50.377193 24007 leader_election.cc:302] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b40eb70d674562aca68b9e19d9c335; no voters: 6ea0c83f0e6744dba477597671a63c6a, c54df34107b7420b95c8bce391769aeb
I20260806 00:55:50.377282 24557 raft_consensus.cc:2726] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 00:55:50.636448 24560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:50.636210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:48985)
0806 00:55:50.636357 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:50.636398 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":71,"threads_started":1}
I20260806 00:55:50.724980 24561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:50.724684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:35519)
0806 00:55:50.724902 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:50.724940 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":137,"threads_started":1}
I20260806 00:55:50.866606 24563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:50.866350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:51835)
0806 00:55:50.866507 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:50.866545 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":88,"threads_started":1}
I20260806 00:55:51.637169 24564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:51.636952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:38427)
0806 00:55:51.637084 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:51.637121 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":67,"threads_started":1}
I20260806 00:55:51.725668 24565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:51.725440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:58249)
0806 00:55:51.725582 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:51.725624 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":68,"threads_started":1}
I20260806 00:55:51.867275 24566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:51.867070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:48009)
0806 00:55:51.867201 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:51.867233 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":67,"threads_started":1}
I20260806 00:55:52.637934 24568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:52.637701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:58231)
0806 00:55:52.637853 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:52.637886 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":89,"threads_started":1}
I20260806 00:55:52.726334 24569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:52.726128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:45577)
0806 00:55:52.726252 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:52.726288 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":63,"threads_started":1}
I20260806 00:55:52.867992 24570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:52.867769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:35833)
0806 00:55:52.867907 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:52.867949 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260806 00:55:53.590234 24571 raft_consensus.cc:482] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:55:53.590342 24571 raft_consensus.cc:504] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:53.590535 24571 leader_election.cc:288] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647), 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569)
W20260806 00:55:53.590978 24011 leader_election.cc:341] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647): Not found: Tablet not found: 41b758f21e8b4c9bbb5a05b2216e83b2
W20260806 00:55:53.591060 24007 leader_election.cc:341] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569): Not found: Tablet not found: 41b758f21e8b4c9bbb5a05b2216e83b2
I20260806 00:55:53.591149 24007 leader_election.cc:302] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b40eb70d674562aca68b9e19d9c335; no voters: 6ea0c83f0e6744dba477597671a63c6a, c54df34107b7420b95c8bce391769aeb
I20260806 00:55:53.591238 24571 raft_consensus.cc:2726] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 00:55:53.638552 24574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:53.638337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:39773)
0806 00:55:53.638470 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:53.638502 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":73,"threads_started":1}
I20260806 00:55:53.727088 24575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:53.726834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:40239)
0806 00:55:53.726994 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:53.727041 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":66,"threads_started":1}
I20260806 00:55:53.868867 24576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:53.868592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:60073)
0806 00:55:53.868775 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:53.868817 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":91,"threads_started":1}
I20260806 00:55:54.639242 24577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:54.638998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:44495)
0806 00:55:54.639154 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:54.639193 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":91,"threads_started":1}
I20260806 00:55:54.727780 24578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:54.727563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:41019)
0806 00:55:54.727697 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:54.727733 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
I20260806 00:55:54.869619 24579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:54.869379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:38245)
0806 00:55:54.869535 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:54.869572 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":75,"threads_started":1}
I20260806 00:55:55.639922 24580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:55.639699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:43765)
0806 00:55:55.639835 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:55.639873 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":68,"threads_started":1}
I20260806 00:55:55.728530 24583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:55.728266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:46709)
0806 00:55:55.728396 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:55.728432 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":61,"threads_started":1}
I20260806 00:55:55.870385 24585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:55.870144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:41065)
0806 00:55:55.870304 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:55.870342 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":66,"threads_started":1}
I20260806 00:55:56.640698 24589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:56.640428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:50399)
0806 00:55:56.640620 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:56.640651 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":133,"threads_started":1}
I20260806 00:55:56.729254 24591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:56.729007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:55315)
0806 00:55:56.729164 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:56.729205 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
I20260806 00:55:56.870725 24593 raft_consensus.cc:482] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:55:56.870949 24593 raft_consensus.cc:504] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c54df34107b7420b95c8bce391769aeb" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 39647 } } peers { permanent_uuid: "6ea0c83f0e6744dba477597671a63c6a" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 40569 } } peers { permanent_uuid: "e4b40eb70d674562aca68b9e19d9c335" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 39245 } }
I20260806 00:55:56.871172 24593 leader_election.cc:288] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647), 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569)
I20260806 00:55:56.871196 24595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:56.870953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:34531)
0806 00:55:56.871079 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:56.871120 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":76,"threads_started":1}
W20260806 00:55:56.871582 24007 leader_election.cc:341] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6ea0c83f0e6744dba477597671a63c6a (127.3.98.130:40569): Not found: Tablet not found: 41b758f21e8b4c9bbb5a05b2216e83b2
W20260806 00:55:56.871662 24011 leader_election.cc:341] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c54df34107b7420b95c8bce391769aeb (127.3.98.131:39647): Not found: Tablet not found: 41b758f21e8b4c9bbb5a05b2216e83b2
I20260806 00:55:56.871727 24011 leader_election.cc:302] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4b40eb70d674562aca68b9e19d9c335; no voters: 6ea0c83f0e6744dba477597671a63c6a, c54df34107b7420b95c8bce391769aeb
I20260806 00:55:56.871824 24593 raft_consensus.cc:2726] T 41b758f21e8b4c9bbb5a05b2216e83b2 P e4b40eb70d674562aca68b9e19d9c335 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 00:55:57.641374 24598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:57.641139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:41303)
0806 00:55:57.641289 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:57.641325 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
I20260806 00:55:57.729934 24602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:57.729719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:39519)
0806 00:55:57.729851 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:57.729887 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":68,"threads_started":1}
I20260806 00:55:57.872104 24603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:57.871796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:58931)
0806 00:55:57.871991 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:57.872032 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":92,"threads_started":1}
I20260806 00:55:58.642086 24605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:58.641850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:40519)
0806 00:55:58.641998 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:58.642039 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":86,"threads_started":1}
I20260806 00:55:58.730619 24606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:58.730395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:58001)
0806 00:55:58.730539 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:58.730573 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":80,"threads_started":1}
I20260806 00:55:58.872988 24607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:58.872733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:57963)
0806 00:55:58.872900 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:58.872940 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":89,"threads_started":1}
I20260806 00:55:59.642783 24608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:59.642555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:59847)
0806 00:55:59.642702 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:59.642734 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
I20260806 00:55:59.731328 24609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:59.731091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:37671)
0806 00:55:59.731240 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:59.731277 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":85,"threads_started":1}
I20260806 00:55:59.873791 24610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:55:59.873543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:60389)
0806 00:55:59.873710 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 00:55:59.873744 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":106,"threads_started":1}
I20260806 00:56:00.643616 24611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:00.643305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:40741)
0806 00:56:00.643459 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:00.643510 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":68,"threads_started":1}
I20260806 00:56:00.732048 24612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:00.731802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:48807)
0806 00:56:00.731962 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:00.731998 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":92,"threads_started":1}
I20260806 00:56:00.874603 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:00.874343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:51171)
0806 00:56:00.874503 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:00.874546 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
I20260806 00:56:01.644464 24614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:01.644193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:60739)
0806 00:56:01.644365 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:01.644411 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":89,"threads_started":1}
I20260806 00:56:01.732851 24615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:01.732628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:34363)
0806 00:56:01.732764 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:01.732801 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
I20260806 00:56:01.875392 24616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:01.875161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:50047)
0806 00:56:01.875304 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:01.875346 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":66,"threads_started":1}
I20260806 00:56:02.645540 24617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:02.645172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.129:47255)
0806 00:56:02.645347 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:02.645459 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":65,"threads_started":1}
I20260806 00:56:02.733588 24618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:02.733353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.130:53641)
0806 00:56:02.733508 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:02.733541 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":66,"threads_started":1}
I20260806 00:56:02.876284 24619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:02.876075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39239 (local address 127.3.98.131:54583)
0806 00:56:02.876203 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:02.876239 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:39239: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
I20260806 00:56:02.877462 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 23940
I20260806 00:56:02.892112 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 24172
I20260806 00:56:02.902014 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 24356
2026-08-06T00:56:02Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18674 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:56:02 dist-test-slave-44d2 krb5kdc[24622](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:56:02 dist-test-slave-44d2 krb5kdc[24622](info): set up 2 sockets
Aug 06 00:56:02 dist-test-slave-44d2 krb5kdc[24622](info): commencing operation
krb5kdc: starting...
W20260806 00:56:04.115514 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:56:04 dist-test-slave-44d2 krb5kdc[24622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977764, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:56:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:56:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:56:04.244587 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44213
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:44213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:56:04.328840 24640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:56:04.329083 24640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:56:04.329119 24640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:56:04.330245 24640 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 00:56:04.330314 24640 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 00:56:04.330335 24640 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 00:56:04.330354 24640 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:56:04.330382 24640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:56:04.330415 24640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:56:04.330439 24640 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:56:04.330476 24640 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:56:04.331969 24640 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:44213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:56:04.332260 24640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:56:04.332513 24640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 00:56:04.338125 24640 server_base.cc:1034] running on GCE node
W20260806 00:56:04.338148 24648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:04.338173 24647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:04.338147 24650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:04.338667 24640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:56:04.339077 24640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:56:04.340278 24640 hybrid_clock.cc:648] HybridClock initialized: now 1785977764340259 us; error 45 us; skew 500 ppm
Aug 06 00:56:04 dist-test-slave-44d2 krb5kdc[24622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977764, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:56:04.343041 24640 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:56:04.343475 24640 webserver.cc:460] Webserver started at http://127.3.98.190:38031/ using document root <none> and password file <none>
I20260806 00:56:04.343711 24640 fs_manager.cc:359] Metadata directory not provided
I20260806 00:56:04.343782 24640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:56:04.343942 24640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:56:04.345088 24640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "f182ce0c659d40df904514e93e48a729"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "6a45846cc81b4dda054126a27e289d2d"
server_key_iv: "3eb91a297104a41169181d31c1752544"
server_key_version: "encryptionkey@0"
I20260806 00:56:04.345472 24640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "f182ce0c659d40df904514e93e48a729"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "6a45846cc81b4dda054126a27e289d2d"
server_key_iv: "3eb91a297104a41169181d31c1752544"
server_key_version: "encryptionkey@0"
I20260806 00:56:04.346828 24640 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 00:56:04.347654 24658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:04.347831 24640 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:56:04.347940 24640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "f182ce0c659d40df904514e93e48a729"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "6a45846cc81b4dda054126a27e289d2d"
server_key_iv: "3eb91a297104a41169181d31c1752544"
server_key_version: "encryptionkey@0"
I20260806 00:56:04.348053 24640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:56:04.359848 24640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:56:04.361778 24640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:56:04.361943 24640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:56:04.366072 24640 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:44213
I20260806 00:56:04.366110 24734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:44213 every 8 connection(s)
I20260806 00:56:04.366458 24640 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:56:04.367383 24735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:56:04.369772 24735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Bootstrap starting.
I20260806 00:56:04.370064 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 24640
I20260806 00:56:04.370157 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:56:04.370394 3466 external_mini_cluster.cc:1428] Setting key 406fae46e23167f02f6b0c885402b707
I20260806 00:56:04.370528 24735 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Neither blocks nor log segments found. Creating new log.
I20260806 00:56:04.370918 24735 log.cc:824] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Log is configured to *not* fsync() on all Append() calls
I20260806 00:56:04.371650 24735 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: No bootstrap required, opened a new log
I20260806 00:56:04.374085 24735 raft_consensus.cc:348] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } }
I20260806 00:56:04.374253 24735 raft_consensus.cc:374] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:56:04.374284 24735 raft_consensus.cc:729] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f182ce0c659d40df904514e93e48a729, State: Initialized, Role: FOLLOWER
I20260806 00:56:04.374397 24735 consensus_queue.cc:260] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } }
I20260806 00:56:04.374462 24735 raft_consensus.cc:388] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:56:04.374498 24735 raft_consensus.cc:482] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:56:04.374541 24735 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:56:04.375113 24735 raft_consensus.cc:504] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } }
I20260806 00:56:04.375254 24735 leader_election.cc:302] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f182ce0c659d40df904514e93e48a729; no voters:
I20260806 00:56:04.375442 24735 leader_election.cc:288] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:56:04.375506 24741 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:56:04.375696 24741 raft_consensus.cc:686] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 1 LEADER]: Becoming Leader. State: Replica: f182ce0c659d40df904514e93e48a729, State: Running, Role: LEADER
I20260806 00:56:04.375805 24735 sys_catalog.cc:564] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:56:04.375854 24741 consensus_queue.cc:237] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } }
I20260806 00:56:04.376379 24742 sys_catalog.cc:455] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f182ce0c659d40df904514e93e48a729. Latest consensus state: current_term: 1 leader_uuid: "f182ce0c659d40df904514e93e48a729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } } }
I20260806 00:56:04.376559 24742 sys_catalog.cc:458] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: This master's current role is: LEADER
I20260806 00:56:04.377056 24751 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:56:04.377099 24743 sys_catalog.cc:455] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f182ce0c659d40df904514e93e48a729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } } }
I20260806 00:56:04.377277 24743 sys_catalog.cc:458] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: This master's current role is: LEADER
I20260806 00:56:04.377597 24751 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 06 00:56:04 dist-test-slave-44d2 krb5kdc[24622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977764, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:56:04.379467 24751 catalog_manager.cc:1347] Generated new cluster ID: 0936893be23c489eabd6f87901ff72ef
I20260806 00:56:04.379530 24751 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:56:04.382145 24739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.370936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58984 (local address 127.3.98.190:44213)
0806 00:56:04.371119 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:04.371130 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:04.371168 (+ 38us) server_negotiation.cc:407] Connection header received
0806 00:56:04.371674 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:04.371702 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:04.371768 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:04.371896 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:56:04.372702 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.373582 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.374685 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.375084 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.375167 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.378295 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:56:04.378299 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:56:04.378300 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:56:04.378312 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:56:04.380442 (+ 2130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:04.380865 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:04.380868 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:04.380868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:04.380984 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:04.381197 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:04.381198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:04.381198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:04.381513 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:56:04.381702 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:04.381784 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 00:56:04.381923 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":77,"threads_started":1}
I20260806 00:56:04.388602 24751 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:56:04.389276 24751 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:56:04.401264 24751 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Generated new TSK 0
I20260806 00:56:04.401463 24751 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:56:04.429716 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44213
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:56:04.515007 24766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:56:04.515270 24766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:56:04.515309 24766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:56:04.516456 24766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:56:04.516548 24766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:56:04.516594 24766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:56:04.518052 24766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:56:04.518311 24766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:56:04.518539 24766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:56:04.523800 24778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:04.523769 24775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:04.523790 24782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:04.524022 24766 server_base.cc:1034] running on GCE node
I20260806 00:56:04.524231 24766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:56:04.524540 24766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:56:04.525710 24766 hybrid_clock.cc:648] HybridClock initialized: now 1785977764525699 us; error 40 us; skew 500 ppm
Aug 06 00:56:04 dist-test-slave-44d2 krb5kdc[24622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977764, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:56:04.528234 24766 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:56:04.528744 24766 webserver.cc:460] Webserver started at http://127.3.98.129:39781/ using document root <none> and password file <none>
I20260806 00:56:04.528973 24766 fs_manager.cc:359] Metadata directory not provided
I20260806 00:56:04.529018 24766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:56:04.529173 24766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:56:04.530215 24766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "fb853cbcef664d5eb745ee8dd81a3dbb"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "c28e885df9a5db974a48e21e7125f171"
server_key_iv: "9988c95b8193428a34ddbc49e3ba9f73"
server_key_version: "encryptionkey@0"
I20260806 00:56:04.530596 24766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "fb853cbcef664d5eb745ee8dd81a3dbb"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "c28e885df9a5db974a48e21e7125f171"
server_key_iv: "9988c95b8193428a34ddbc49e3ba9f73"
server_key_version: "encryptionkey@0"
I20260806 00:56:04.531963 24766 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 00:56:04.532744 24792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:04.532922 24766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:56:04.532999 24766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "fb853cbcef664d5eb745ee8dd81a3dbb"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "c28e885df9a5db974a48e21e7125f171"
server_key_iv: "9988c95b8193428a34ddbc49e3ba9f73"
server_key_version: "encryptionkey@0"
I20260806 00:56:04.533104 24766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:56:04.555298 24766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:56:04.557242 24766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:56:04.557427 24766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:56:04.557677 24766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:56:04.558010 24766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:56:04.558068 24766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:04.558104 24766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:56:04.558149 24766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:04.564443 24766 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:33855
I20260806 00:56:04.564550 24949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:33855 every 8 connection(s)
I20260806 00:56:04.564882 24766 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:56:04.565593 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 24766
I20260806 00:56:04.565727 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:56:04.565943 3466 external_mini_cluster.cc:1428] Setting key e8a4a277d38ff1bd6062c8345b0fdb5b
Aug 06 00:56:04 dist-test-slave-44d2 krb5kdc[24622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977764, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:56:04.575625 24739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.565640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:51217 (local address 127.3.98.190:44213)
0806 00:56:04.565694 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:04.565696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:04.565939 (+ 243us) server_negotiation.cc:407] Connection header received
0806 00:56:04.566598 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:04.566599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:04.566613 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:04.566671 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:56:04.567696 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.568221 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.569355 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.569595 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.569688 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.572359 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:56:04.572361 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:56:04.572361 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:56:04.572369 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:56:04.573915 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:04.574474 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:04.574475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:04.574476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:04.574545 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:04.574897 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:04.574898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:04.574899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:04.575030 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:56:04.575105 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:04.575471 (+ 366us) server_negotiation.cc:299] Negotiation successful
0806 00:56:04.575552 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 00:56:04.575971 24952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.565632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:51217)
0806 00:56:04.565790 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:04.565832 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:04.566477 (+ 645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:04.566747 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:04.566751 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:04.567370 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:56:04.567578 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:04.567583 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.568331 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.568333 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:04.569253 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:04.569256 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.569704 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.569705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:04.569846 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.570378 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:56:04.570386 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:56:04.572255 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:56:04.574015 (+ 1760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:04.574024 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:04.574027 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:04.574368 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:04.574636 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:04.574637 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:04.574638 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:04.574805 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:04.575110 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:56:04.575119 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:56:04.575311 (+ 192us) client_negotiation.cc:769] Sending connection context
0806 00:56:04.575450 (+ 139us) client_negotiation.cc:240] Negotiation successful
0806 00:56:04.575656 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
I20260806 00:56:04.576692 24950 heartbeater.cc:347] Connected to a master server at 127.3.98.190:44213
I20260806 00:56:04.576825 24950 heartbeater.cc:464] Registering TS with master...
I20260806 00:56:04.577044 24950 heartbeater.cc:511] Master 127.3.98.190:44213 requested a full tablet report, sending...
I20260806 00:56:04.577687 24678 ts_manager.cc:194] Registered new tserver with Master: fb853cbcef664d5eb745ee8dd81a3dbb (127.3.98.129:33855)
I20260806 00:56:04.578377 24678 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:51217
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:56:04.595657 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44213
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:56:04.685205 24955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:56:04.685410 24955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:56:04.685434 24955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:56:04.686513 24955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:56:04.686549 24955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:56:04.686591 24955 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:56:04.688023 24955 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:56:04.688220 24955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:56:04.688395 24955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:56:04.693562 24968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:04.693614 24965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:04.693573 24964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:04.693830 24955 server_base.cc:1034] running on GCE node
I20260806 00:56:04.694051 24955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:56:04.694301 24955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:56:04.695487 24955 hybrid_clock.cc:648] HybridClock initialized: now 1785977764695472 us; error 43 us; skew 500 ppm
Aug 06 00:56:04 dist-test-slave-44d2 krb5kdc[24622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977764, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:56:04.698055 24955 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:56:04.698489 24955 webserver.cc:460] Webserver started at http://127.3.98.130:39747/ using document root <none> and password file <none>
I20260806 00:56:04.698743 24955 fs_manager.cc:359] Metadata directory not provided
I20260806 00:56:04.698823 24955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:56:04.698977 24955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:56:04.700023 24955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "e2a07666977047339a9f6f352eff9234"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "52ac237c990cad036cd7c97f71c79941"
server_key_iv: "bb5507bb5e7c0b6167b0f9ec83671367"
server_key_version: "encryptionkey@0"
I20260806 00:56:04.700384 24955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "e2a07666977047339a9f6f352eff9234"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "52ac237c990cad036cd7c97f71c79941"
server_key_iv: "bb5507bb5e7c0b6167b0f9ec83671367"
server_key_version: "encryptionkey@0"
I20260806 00:56:04.701779 24955 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:56:04.702544 24977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:04.702720 24955 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:04.702827 24955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "e2a07666977047339a9f6f352eff9234"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "52ac237c990cad036cd7c97f71c79941"
server_key_iv: "bb5507bb5e7c0b6167b0f9ec83671367"
server_key_version: "encryptionkey@0"
I20260806 00:56:04.702901 24955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:56:04.742015 24955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:56:04.744041 24955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:56:04.744218 24955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:56:04.744534 24955 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:56:04.744890 24955 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:56:04.744946 24955 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:04.744982 24955 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:56:04.745013 24955 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:04.751380 24955 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:44343
I20260806 00:56:04.751469 25139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:44343 every 8 connection(s)
I20260806 00:56:04.751848 24955 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
Aug 06 00:56:04 dist-test-slave-44d2 krb5kdc[24622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977764, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:56:04.760877 24739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.752710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:56637 (local address 127.3.98.190:44213)
0806 00:56:04.752794 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:04.752797 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:04.752988 (+ 191us) server_negotiation.cc:407] Connection header received
0806 00:56:04.753486 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:04.753486 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:04.753498 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:04.753552 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:56:04.754504 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.754996 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.755976 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.756157 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.756209 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.758391 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:56:04.758393 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:56:04.758393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:56:04.758399 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:56:04.759642 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:04.760014 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:04.760015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:04.760015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:04.760068 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:04.760286 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:04.760287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:04.760287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:04.760385 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:56:04.760436 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:04.760741 (+ 305us) server_negotiation.cc:299] Negotiation successful
0806 00:56:04.760810 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 00:56:04.761035 25143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.752673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:56637)
0806 00:56:04.752857 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:04.752896 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:04.753377 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:04.753611 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:04.753615 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:04.754220 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:56:04.754424 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:04.754429 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.755096 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.755097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:04.755897 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:04.755899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.756231 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.756232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:04.756343 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.756867 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:56:04.756876 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:56:04.758302 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:56:04.759714 (+ 1412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:04.759721 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:04.759723 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:04.759948 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:04.760128 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:04.760129 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:04.760129 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:04.760231 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:04.760440 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:56:04.760444 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:56:04.760619 (+ 175us) client_negotiation.cc:769] Sending connection context
0806 00:56:04.760707 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 00:56:04.760830 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":114,"threads_started":1}
I20260806 00:56:04.761552 25140 heartbeater.cc:347] Connected to a master server at 127.3.98.190:44213
I20260806 00:56:04.761653 25140 heartbeater.cc:464] Registering TS with master...
I20260806 00:56:04.761821 25140 heartbeater.cc:511] Master 127.3.98.190:44213 requested a full tablet report, sending...
I20260806 00:56:04.762032 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 24955
I20260806 00:56:04.762176 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:56:04.762229 24678 ts_manager.cc:194] Registered new tserver with Master: e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343)
I20260806 00:56:04.762413 3466 external_mini_cluster.cc:1428] Setting key 78860956b326872946fde3555bedb36b
I20260806 00:56:04.762753 24678 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:56637
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:56:04.791651 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44213
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:56:04.880108 25148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:56:04.880326 25148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:56:04.880354 25148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:56:04.881760 25148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:56:04.881812 25148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:56:04.881883 25148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:56:04.883641 25148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:44213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:56:04.883885 25148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:56:04.884104 25148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:56:04.889667 25156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:04.889688 25160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:04.889688 25154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:04.890017 25148 server_base.cc:1034] running on GCE node
I20260806 00:56:04.890244 25148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:56:04.890507 25148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:56:04.891723 25148 hybrid_clock.cc:648] HybridClock initialized: now 1785977764891714 us; error 37 us; skew 500 ppm
Aug 06 00:56:04 dist-test-slave-44d2 krb5kdc[24622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977764, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:56:04.894598 25148 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:56:04.895103 25148 webserver.cc:460] Webserver started at http://127.3.98.131:43117/ using document root <none> and password file <none>
I20260806 00:56:04.895331 25148 fs_manager.cc:359] Metadata directory not provided
I20260806 00:56:04.895381 25148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:56:04.895480 25148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:56:04.896647 25148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "311678ef8a90499a8264a6d30b5b5a5e"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "38ca325554b36a36c60449ffc448beb1"
server_key_iv: "1bc35114c01139ae697687127e69ef92"
server_key_version: "encryptionkey@0"
I20260806 00:56:04.897049 25148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "311678ef8a90499a8264a6d30b5b5a5e"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "38ca325554b36a36c60449ffc448beb1"
server_key_iv: "1bc35114c01139ae697687127e69ef92"
server_key_version: "encryptionkey@0"
I20260806 00:56:04.898479 25148 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:56:04.899359 25173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:04.899560 25148 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:56:04.899639 25148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "311678ef8a90499a8264a6d30b5b5a5e"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "38ca325554b36a36c60449ffc448beb1"
server_key_iv: "1bc35114c01139ae697687127e69ef92"
server_key_version: "encryptionkey@0"
I20260806 00:56:04.899693 25148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:56:04.923774 25148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:56:04.926138 25148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:56:04.926257 25148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:56:04.926465 25148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:56:04.926824 25148 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:56:04.926888 25148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:04.926925 25148 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:56:04.926970 25148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:04.933223 25148 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:38299
I20260806 00:56:04.933272 25321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:38299 every 8 connection(s)
I20260806 00:56:04.933604 25148 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:56:04.937582 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 25148
I20260806 00:56:04.937736 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:56:04.937966 3466 external_mini_cluster.cc:1428] Setting key 12e0187f7e99401cec2e63d5ee62949b
Aug 06 00:56:04 dist-test-slave-44d2 krb5kdc[24622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977764, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:56:04.944010 24739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.934366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:53739 (local address 127.3.98.190:44213)
0806 00:56:04.934437 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:04.934439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:04.934734 (+ 295us) server_negotiation.cc:407] Connection header received
0806 00:56:04.935284 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:04.935286 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:04.935299 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:04.935348 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:56:04.936332 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.936925 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.938071 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.938348 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.938434 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.940894 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:56:04.940896 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:56:04.940896 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:56:04.940904 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:56:04.942338 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:04.942797 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:04.942798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:04.942799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:04.942932 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:04.943195 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:04.943196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:04.943196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:04.943418 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:56:04.943500 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:04.943825 (+ 325us) server_negotiation.cc:299] Negotiation successful
0806 00:56:04.943920 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 00:56:04.944199 25324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.934396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:53739)
0806 00:56:04.934602 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:04.934642 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:04.935172 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:04.935431 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:04.935434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:04.936007 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:56:04.936216 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:04.936220 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.937031 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.937033 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:04.937966 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:04.937969 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.938446 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.938448 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:04.938586 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.939155 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:56:04.939164 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:56:04.940784 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:56:04.942459 (+ 1675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:04.942467 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:04.942469 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:04.942712 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:04.943009 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:04.943010 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:04.943010 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:04.943123 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:04.943503 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:56:04.943511 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:56:04.943652 (+ 141us) client_negotiation.cc:769] Sending connection context
0806 00:56:04.943791 (+ 139us) client_negotiation.cc:240] Negotiation successful
0806 00:56:04.943963 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":98,"threads_started":1}
I20260806 00:56:04.944696 25322 heartbeater.cc:347] Connected to a master server at 127.3.98.190:44213
I20260806 00:56:04.944785 25322 heartbeater.cc:464] Registering TS with master...
I20260806 00:56:04.945000 25322 heartbeater.cc:511] Master 127.3.98.190:44213 requested a full tablet report, sending...
I20260806 00:56:04.945547 24677 ts_manager.cc:194] Registered new tserver with Master: 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299)
I20260806 00:56:04.945960 24677 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:53739
I20260806 00:56:04.949932 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:56:04.957434 24739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.951367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59000 (local address 127.3.98.190:44213)
0806 00:56:04.951455 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:04.951457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:04.951510 (+ 53us) server_negotiation.cc:407] Connection header received
0806 00:56:04.951564 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:04.951565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:04.951573 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:04.951670 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:56:04.952249 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.952861 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.953573 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.953751 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.953800 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.954948 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:56:04.954949 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:56:04.954950 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:56:04.954958 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:56:04.956414 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:04.956787 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:04.956787 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:04.956788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:04.956840 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:04.957007 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:04.957008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:04.957008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:04.957148 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:56:04.957225 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:04.957309 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 00:56:04.957370 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 00:56:04.959082 24677 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59000:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:56:04.960716 24677 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:56:04.967432 25344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.963554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35366 (local address 127.3.98.129:33855)
0806 00:56:04.963729 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:04.963733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:04.963742 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:56:04.963783 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:04.963785 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:04.963801 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:04.963882 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:56:04.964176 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.965251 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.966503 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.967000 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.967093 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.967157 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:04.967302 (+ 145us) server_negotiation.cc:299] Negotiation successful
0806 00:56:04.967345 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":100,"threads_started":1}
I20260806 00:56:04.967499 25338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.963070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:44343 (local address 127.0.0.1:47194)
0806 00:56:04.963257 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:04.963296 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:04.963367 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:04.963642 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:04.963645 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:04.963647 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:56:04.963716 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:04.963718 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.965259 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.965260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:04.966362 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:04.966365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.967234 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.967235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:04.967295 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.967298 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:56:04.967326 (+ 28us) client_negotiation.cc:240] Negotiation successful
0806 00:56:04.967362 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":64,"thread_start_us":66,"threads_started":1}
I20260806 00:56:04.967604 25340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.963073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:38299 (local address 127.0.0.1:41126)
0806 00:56:04.963416 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:04.963428 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:04.963543 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:04.963889 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:04.963890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:04.963892 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:56:04.963941 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:04.963942 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.964982 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.964983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:04.966210 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:04.966213 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.967137 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.967138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:04.967213 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.967218 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:56:04.967250 (+ 32us) client_negotiation.cc:240] Negotiation successful
0806 00:56:04.967316 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":99,"threads_started":1}
I20260806 00:56:04.967635 25341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.963166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41126 (local address 127.3.98.131:38299)
0806 00:56:04.963365 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:04.963370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:04.963508 (+ 138us) server_negotiation.cc:407] Connection header received
0806 00:56:04.963756 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:04.963759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:04.963778 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:04.963878 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:56:04.964020 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.964867 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.966293 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.967030 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.967407 (+ 377us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.967472 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:04.967514 (+ 42us) server_negotiation.cc:299] Negotiation successful
0806 00:56:04.967558 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":83,"threads_started":1}
I20260806 00:56:04.967664 25342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.963219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47194 (local address 127.3.98.130:44343)
0806 00:56:04.963482 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:04.963486 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:04.963496 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:56:04.963541 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:04.963543 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:04.963560 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:04.963640 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:56:04.963786 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.965143 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.966455 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.967150 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.967468 (+ 318us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.967529 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:04.967552 (+ 23us) server_negotiation.cc:299] Negotiation successful
0806 00:56:04.967591 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":89,"threads_started":1}
I20260806 00:56:04.967420 25343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:04.963289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:33855 (local address 127.0.0.1:35366)
0806 00:56:04.963491 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:04.963501 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:04.963543 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:04.963967 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:04.963968 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:04.963971 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:56:04.964089 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:04.964091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.965356 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.965357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:04.966414 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:04.966416 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:04.967092 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:04.967093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:04.967172 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:04.967187 (+ 15us) client_negotiation.cc:769] Sending connection context
0806 00:56:04.967284 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 00:56:04.967330 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":73,"threads_started":1}
I20260806 00:56:04.968529 25233 tablet_service.cc:1467] Processing CreateTablet for tablet cb6c1739837c4ac5b1262dfe19c3731d (DEFAULT_TABLE table=test-table [id=3a0592fa53454712a3abbbd1031f1e2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:56:04.968823 24859 tablet_service.cc:1467] Processing CreateTablet for tablet cb6c1739837c4ac5b1262dfe19c3731d (DEFAULT_TABLE table=test-table [id=3a0592fa53454712a3abbbd1031f1e2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:56:04.968930 25233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb6c1739837c4ac5b1262dfe19c3731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:56:04.969169 24859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb6c1739837c4ac5b1262dfe19c3731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:56:04.971742 25345 tablet_bootstrap.cc:492] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e: Bootstrap starting.
I20260806 00:56:04.971855 25052 tablet_service.cc:1467] Processing CreateTablet for tablet cb6c1739837c4ac5b1262dfe19c3731d (DEFAULT_TABLE table=test-table [id=3a0592fa53454712a3abbbd1031f1e2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:56:04.972190 25052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb6c1739837c4ac5b1262dfe19c3731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:56:04.972429 25345 tablet_bootstrap.cc:654] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e: Neither blocks nor log segments found. Creating new log.
I20260806 00:56:04.972693 25346 tablet_bootstrap.cc:492] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Bootstrap starting.
I20260806 00:56:04.973148 25345 log.cc:824] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e: Log is configured to *not* fsync() on all Append() calls
I20260806 00:56:04.973403 25346 tablet_bootstrap.cc:654] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Neither blocks nor log segments found. Creating new log.
I20260806 00:56:04.973943 25346 log.cc:824] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Log is configured to *not* fsync() on all Append() calls
I20260806 00:56:04.974068 25345 tablet_bootstrap.cc:492] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e: No bootstrap required, opened a new log
I20260806 00:56:04.974139 25345 ts_tablet_manager.cc:1397] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:56:04.974797 25346 tablet_bootstrap.cc:492] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: No bootstrap required, opened a new log
I20260806 00:56:04.974869 25346 ts_tablet_manager.cc:1397] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:56:04.975373 25350 tablet_bootstrap.cc:492] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234: Bootstrap starting.
I20260806 00:56:04.976006 25350 tablet_bootstrap.cc:654] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234: Neither blocks nor log segments found. Creating new log.
I20260806 00:56:04.976562 25350 log.cc:824] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234: Log is configured to *not* fsync() on all Append() calls
I20260806 00:56:04.976378 25345 raft_consensus.cc:348] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:04.976642 25345 raft_consensus.cc:374] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:56:04.976747 25345 raft_consensus.cc:729] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 311678ef8a90499a8264a6d30b5b5a5e, State: Initialized, Role: FOLLOWER
I20260806 00:56:04.976872 25345 consensus_queue.cc:260] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:04.977172 25345 ts_tablet_manager.cc:1428] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:56:04.977196 25322 heartbeater.cc:503] Master 127.3.98.190:44213 was elected leader, sending a full tablet report...
I20260806 00:56:04.977373 25346 raft_consensus.cc:348] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:04.977522 25346 raft_consensus.cc:374] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:56:04.977567 25346 raft_consensus.cc:729] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb853cbcef664d5eb745ee8dd81a3dbb, State: Initialized, Role: FOLLOWER
I20260806 00:56:04.977821 25346 consensus_queue.cc:260] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:04.978125 24950 heartbeater.cc:503] Master 127.3.98.190:44213 was elected leader, sending a full tablet report...
I20260806 00:56:04.978124 25346 ts_tablet_manager.cc:1428] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:56:04.978988 25350 tablet_bootstrap.cc:492] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234: No bootstrap required, opened a new log
I20260806 00:56:04.979066 25350 ts_tablet_manager.cc:1397] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260806 00:56:04.980459 25350 raft_consensus.cc:348] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:04.980666 25350 raft_consensus.cc:374] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:56:04.980691 25350 raft_consensus.cc:729] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a07666977047339a9f6f352eff9234, State: Initialized, Role: FOLLOWER
I20260806 00:56:04.980821 25350 consensus_queue.cc:260] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:04.981101 25350 ts_tablet_manager.cc:1428] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 00:56:04.981113 25140 heartbeater.cc:503] Master 127.3.98.190:44213 was elected leader, sending a full tablet report...
W20260806 00:56:05.002548 25141 tablet.cc:2369] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:56:05.041514 25358 raft_consensus.cc:482] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:56:05.041654 25358 raft_consensus.cc:504] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:05.042011 25358 leader_election.cc:288] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299), fb853cbcef664d5eb745ee8dd81a3dbb (127.3.98.129:33855)
I20260806 00:56:05.045009 25341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:05.042328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:52955 (local address 127.3.98.131:38299)
0806 00:56:05.042409 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:05.042412 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:05.042440 (+ 28us) server_negotiation.cc:407] Connection header received
0806 00:56:05.042468 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:05.042469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:05.042479 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:05.042529 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:56:05.042712 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:05.043276 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:05.044239 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:05.044639 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:05.044726 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:05.044737 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:05.044897 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 00:56:05.044936 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 00:56:05.045009 25143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:05.042199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:38299 (local address 127.3.98.130:52955)
0806 00:56:05.042310 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:05.042326 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:05.042401 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:05.042536 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:05.042537 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:05.042538 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:56:05.042625 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:05.042627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:05.043370 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:05.043371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:05.044135 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:05.044138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:05.044738 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:05.044739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:05.044819 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:05.044823 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:56:05.044891 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 00:56:05.044932 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260806 00:56:05.045199 25359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:05.042367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:33855 (local address 127.3.98.130:51189)
0806 00:56:05.042539 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:05.042550 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:05.042645 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:05.042795 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:05.042796 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:05.042798 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:56:05.042874 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:05.042876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:05.043535 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:05.043536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:05.044282 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:05.044283 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:05.044910 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:05.044911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:05.044997 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:05.045005 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 00:56:05.045068 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 00:56:05.045108 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":121,"threads_started":1}
I20260806 00:56:05.045192 25344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:05.042436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:51189 (local address 127.3.98.129:33855)
0806 00:56:05.042498 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:05.042500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:05.042637 (+ 137us) server_negotiation.cc:407] Connection header received
0806 00:56:05.042712 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:05.042713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:05.042725 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:05.042793 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:56:05.042989 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:05.043439 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:05.044378 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:05.044813 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:05.044908 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:05.044917 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:05.045088 (+ 171us) server_negotiation.cc:299] Negotiation successful
0806 00:56:05.045131 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 00:56:05.045396 25259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6c1739837c4ac5b1262dfe19c3731d" candidate_uuid: "e2a07666977047339a9f6f352eff9234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "311678ef8a90499a8264a6d30b5b5a5e" is_pre_election: true
I20260806 00:56:05.045578 25259 raft_consensus.cc:2454] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a07666977047339a9f6f352eff9234 in term 0.
I20260806 00:56:05.045857 24981 leader_election.cc:302] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 311678ef8a90499a8264a6d30b5b5a5e, e2a07666977047339a9f6f352eff9234; no voters:
I20260806 00:56:05.045997 24889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6c1739837c4ac5b1262dfe19c3731d" candidate_uuid: "e2a07666977047339a9f6f352eff9234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" is_pre_election: true
I20260806 00:56:05.046032 25358 raft_consensus.cc:2781] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:56:05.046120 25358 raft_consensus.cc:482] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:56:05.046144 24889 raft_consensus.cc:2454] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2a07666977047339a9f6f352eff9234 in term 0.
I20260806 00:56:05.046159 25358 raft_consensus.cc:3037] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:56:05.046908 25358 raft_consensus.cc:504] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:05.047063 25358 leader_election.cc:288] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [CANDIDATE]: Term 1 election: Requested vote from peers 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299), fb853cbcef664d5eb745ee8dd81a3dbb (127.3.98.129:33855)
I20260806 00:56:05.047304 25259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6c1739837c4ac5b1262dfe19c3731d" candidate_uuid: "e2a07666977047339a9f6f352eff9234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "311678ef8a90499a8264a6d30b5b5a5e"
I20260806 00:56:05.047304 24889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6c1739837c4ac5b1262dfe19c3731d" candidate_uuid: "e2a07666977047339a9f6f352eff9234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb"
I20260806 00:56:05.047391 25259 raft_consensus.cc:3037] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:56:05.047391 24889 raft_consensus.cc:3037] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:56:05.048358 24889 raft_consensus.cc:2454] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a07666977047339a9f6f352eff9234 in term 1.
I20260806 00:56:05.048357 25259 raft_consensus.cc:2454] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2a07666977047339a9f6f352eff9234 in term 1.
I20260806 00:56:05.048555 24981 leader_election.cc:302] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 311678ef8a90499a8264a6d30b5b5a5e, e2a07666977047339a9f6f352eff9234; no voters:
I20260806 00:56:05.048669 25358 raft_consensus.cc:2781] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:56:05.048838 25358 raft_consensus.cc:686] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [term 1 LEADER]: Becoming Leader. State: Replica: e2a07666977047339a9f6f352eff9234, State: Running, Role: LEADER
I20260806 00:56:05.048936 25358 consensus_queue.cc:237] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:05.049742 24677 catalog_manager.cc:5495] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2a07666977047339a9f6f352eff9234 (127.3.98.130). New cstate: current_term: 1 leader_uuid: "e2a07666977047339a9f6f352eff9234" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } health_report { overall_health: UNKNOWN } } }
I20260806 00:56:05.059424 25342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:05.057150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47196 (local address 127.3.98.130:44343)
0806 00:56:05.057229 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:05.057231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:05.057241 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:56:05.057296 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:05.057297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:05.057314 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:05.057398 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:56:05.057541 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:05.057979 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:05.058699 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:05.058886 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:05.058949 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:05.059079 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:56:05.059174 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:56:05.059233 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:05.059270 (+ 37us) server_negotiation.cc:299] Negotiation successful
0806 00:56:05.059285 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 00:56:05.061549 24889 raft_consensus.cc:1261] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Refusing update from remote peer e2a07666977047339a9f6f352eff9234: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:56:05.061625 25259 raft_consensus.cc:1261] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e [term 1 FOLLOWER]: Refusing update from remote peer e2a07666977047339a9f6f352eff9234: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:56:05.062034 25358 consensus_queue.cc:1035] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:56:05.062170 25360 consensus_queue.cc:1035] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [LEADER]: Connected to new peer: Peer: permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:56:05.065119 25364 mvcc.cc:205] Tried to move back new op lower bound from 7315364925689237504 to 7315364925640962048. Current Snapshot: MvccSnapshot[applied={T|T < 7315364925689237504}]
I20260806 00:56:05.066134 25366 mvcc.cc:205] Tried to move back new op lower bound from 7315364925689237504 to 7315364925640962048. Current Snapshot: MvccSnapshot[applied={T|T < 7315364925689237504 or (T in {7315364925689237504})}]
I20260806 00:56:05.067574 24677 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:56:05.067695 24677 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:56:05.068598 24677 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Sending DeleteTablet for 3 replicas of tablet cb6c1739837c4ac5b1262dfe19c3731d
I20260806 00:56:05.068944 25052 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6c1739837c4ac5b1262dfe19c3731d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:56:05 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:47194
I20260806 00:56:05.069062 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 24766
I20260806 00:56:05.069216 25381 tablet_replica.cc:330] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234: stopping tablet replica
I20260806 00:56:05.069320 25381 raft_consensus.cc:2229] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:56:05.069432 25381 raft_consensus.cc:2258] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:56:05.071755 25381 ts_tablet_manager.cc:1905] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:56:05.073817 25381 ts_tablet_manager.cc:1918] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:56:05.073901 25381 log.cc:1196] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/cb6c1739837c4ac5b1262dfe19c3731d
I20260806 00:56:05.074256 25381 ts_tablet_manager.cc:1939] T cb6c1739837c4ac5b1262dfe19c3731d P e2a07666977047339a9f6f352eff9234: Deleting consensus metadata
I20260806 00:56:05.074791 24659 catalog_manager.cc:4841] TS e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343): tablet cb6c1739837c4ac5b1262dfe19c3731d (table test-table [id=3a0592fa53454712a3abbbd1031f1e2d]) successfully deleted
I20260806 00:56:05.079428 25233 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6c1739837c4ac5b1262dfe19c3731d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:56:05 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:41126
I20260806 00:56:05.079756 25382 tablet_replica.cc:330] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e: stopping tablet replica
I20260806 00:56:05.079950 25382 raft_consensus.cc:2229] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:56:05.080142 25382 raft_consensus.cc:2258] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:56:05.080752 25382 ts_tablet_manager.cc:1905] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:56:05.083009 25382 ts_tablet_manager.cc:1918] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:56:05.083101 25382 log.cc:1196] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/cb6c1739837c4ac5b1262dfe19c3731d
I20260806 00:56:05.083410 25382 ts_tablet_manager.cc:1939] T cb6c1739837c4ac5b1262dfe19c3731d P 311678ef8a90499a8264a6d30b5b5a5e: Deleting consensus metadata
I20260806 00:56:05.083904 24661 catalog_manager.cc:4841] TS 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299): tablet cb6c1739837c4ac5b1262dfe19c3731d (table test-table [id=3a0592fa53454712a3abbbd1031f1e2d]) successfully deleted
W20260806 00:56:05.085484 24661 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:33855 (error 108)
I20260806 00:56:05.085862 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 24955
I20260806 00:56:05.091738 25343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:05.091520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:33855 (local address 127.0.0.1:35382)
0806 00:56:05.091599 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:05.091681 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:33855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 00:56:05.093111 24661 catalog_manager.cc:4584] TS fb853cbcef664d5eb745ee8dd81a3dbb (127.3.98.129:33855): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cb6c1739837c4ac5b1262dfe19c3731d: Network error: Client connection negotiation failed: client connection to 127.3.98.129:33855: connect: Connection refused (error 111)
I20260806 00:56:05.099539 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 25148
I20260806 00:56:05.106244 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 24640
I20260806 00:56:25.115566 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44213
--webserver_interface=127.3.98.190
--webserver_port=38031
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:44213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:56:25.202003 25384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:56:25.202219 25384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:56:25.202242 25384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:56:25.203424 25384 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 00:56:25.203467 25384 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 00:56:25.203481 25384 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 00:56:25.203493 25384 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:56:25.203506 25384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:56:25.203557 25384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:56:25.203594 25384 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:56:25.203611 25384 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:56:25.205193 25384 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:44213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=38031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25384
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:56:25.205472 25384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:56:25.205729 25384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:56:25.215762 25391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:25.215883 25384 server_base.cc:1034] running on GCE node
W20260806 00:56:25.215763 25390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:25.215763 25394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:25.216318 25384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:56:25.216706 25384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:56:25.217885 25384 hybrid_clock.cc:648] HybridClock initialized: now 1785977785217874 us; error 40 us; skew 500 ppm
Aug 06 00:56:25 dist-test-slave-44d2 krb5kdc[24622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977785, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:56:25.224645 25384 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:56:25.225322 25384 webserver.cc:460] Webserver started at http://127.3.98.190:38031/ using document root <none> and password file <none>
I20260806 00:56:25.225625 25384 fs_manager.cc:359] Metadata directory not provided
I20260806 00:56:25.225711 25384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:56:25.227715 25384 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:56:25.228566 25404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:25.228765 25384 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:56:25.228856 25384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "f182ce0c659d40df904514e93e48a729"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "6a45846cc81b4dda054126a27e289d2d"
server_key_iv: "3eb91a297104a41169181d31c1752544"
server_key_version: "encryptionkey@0"
I20260806 00:56:25.229249 25384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:56:25.237911 25384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:56:25.239688 25384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:56:25.239800 25384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:56:25.244213 25384 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:44213
I20260806 00:56:25.244246 25476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:44213 every 8 connection(s)
I20260806 00:56:25.244742 25384 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:56:25.246342 25479 sys_catalog.cc:263] Verifying existing consensus state
I20260806 00:56:25.247051 25479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Bootstrap starting.
I20260806 00:56:25.252813 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 25384
I20260806 00:56:25.253209 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:33855
--local_ip_for_outbound_sockets=127.3.98.129
--tserver_master_addrs=127.3.98.190:44213
--webserver_port=39781
--webserver_interface=127.3.98.129
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:56:25.257910 25479 log.cc:824] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Log is configured to *not* fsync() on all Append() calls
I20260806 00:56:25.260232 25479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 00:56:25.260674 25479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Bootstrap complete.
I20260806 00:56:25.263207 25479 raft_consensus.cc:348] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } }
I20260806 00:56:25.263451 25479 raft_consensus.cc:729] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f182ce0c659d40df904514e93e48a729, State: Initialized, Role: FOLLOWER
I20260806 00:56:25.263631 25479 consensus_queue.cc:260] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } }
I20260806 00:56:25.263705 25479 raft_consensus.cc:388] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:56:25.263777 25479 raft_consensus.cc:482] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:56:25.263865 25479 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 1 FOLLOWER]: Advancing to term 2
I20260806 00:56:25.265079 25479 raft_consensus.cc:504] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } }
I20260806 00:56:25.265175 25479 leader_election.cc:302] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f182ce0c659d40df904514e93e48a729; no voters:
I20260806 00:56:25.265398 25479 leader_election.cc:288] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 00:56:25.265446 25483 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 00:56:25.265640 25483 raft_consensus.cc:686] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 2 LEADER]: Becoming Leader. State: Replica: f182ce0c659d40df904514e93e48a729, State: Running, Role: LEADER
I20260806 00:56:25.265705 25479 sys_catalog.cc:564] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:56:25.266980 25483 consensus_queue.cc:237] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } }
I20260806 00:56:25.267580 25485 sys_catalog.cc:455] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f182ce0c659d40df904514e93e48a729. Latest consensus state: current_term: 2 leader_uuid: "f182ce0c659d40df904514e93e48a729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } } }
I20260806 00:56:25.267652 25484 sys_catalog.cc:455] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f182ce0c659d40df904514e93e48a729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } } }
I20260806 00:56:25.267844 25485 sys_catalog.cc:458] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: This master's current role is: LEADER
I20260806 00:56:25.267856 25484 sys_catalog.cc:458] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: This master's current role is: LEADER
I20260806 00:56:25.268316 25498 catalog_manager.cc:1259] Loaded cluster ID: 0936893be23c489eabd6f87901ff72ef
I20260806 00:56:25.268370 25498 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: loading cluster ID for follower catalog manager: success
I20260806 00:56:25.269556 25498 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: acquiring CA information for follower catalog manager: success
I20260806 00:56:25.270210 25498 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 00:56:25.270395 25501 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:56:25.270994 25501 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:56:25.271095 25501 catalog_manager.cc:1259] Loaded cluster ID: 0936893be23c489eabd6f87901ff72ef
I20260806 00:56:25.271128 25501 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:56:25.271368 25501 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:56:25.271464 25501 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Loaded TSK: 0
I20260806 00:56:25.303306 25501 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Generated new TSK 1
I20260806 00:56:25.303431 25501 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 00:56:25.340946 25481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:56:25.341187 25481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:56:25.341225 25481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:56:25.342371 25481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:56:25.342442 25481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:56:25.342485 25481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:56:25.344005 25481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:33855
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=39781
--tserver_master_addrs=127.3.98.190:44213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:56:25.344271 25481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:56:25.344553 25481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:56:25.350590 25510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:25.350631 25511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:25.350608 25515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:25.351257 25481 server_base.cc:1034] running on GCE node
I20260806 00:56:25.351478 25481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:56:25.351735 25481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:56:25.352901 25481 hybrid_clock.cc:648] HybridClock initialized: now 1785977785352891 us; error 38 us; skew 500 ppm
Aug 06 00:56:25 dist-test-slave-44d2 krb5kdc[24622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977785, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:56:25.355486 25481 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:56:25.355969 25481 webserver.cc:460] Webserver started at http://127.3.98.129:39781/ using document root <none> and password file <none>
I20260806 00:56:25.356206 25481 fs_manager.cc:359] Metadata directory not provided
I20260806 00:56:25.356297 25481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:56:25.357810 25481 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:56:25.358597 25524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:25.358753 25481 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:56:25.358842 25481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "fb853cbcef664d5eb745ee8dd81a3dbb"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "c28e885df9a5db974a48e21e7125f171"
server_key_iv: "9988c95b8193428a34ddbc49e3ba9f73"
server_key_version: "encryptionkey@0"
I20260806 00:56:25.359185 25481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:56:25.386974 25481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:56:25.389986 25481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:56:25.390172 25481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:56:25.390470 25481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:56:25.390961 25534 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 00:56:25.393061 25481 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 00:56:25.393132 25481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 00:56:25.393177 25481 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 00:56:25.393832 25481 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 00:56:25.393893 25481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260806 00:56:25.393975 25534 tablet_bootstrap.cc:492] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Bootstrap starting.
I20260806 00:56:25.401590 25481 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:33855
I20260806 00:56:25.401644 25689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:33855 every 8 connection(s)
I20260806 00:56:25.402087 25481 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:56:25.405339 25534 log.cc:824] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Log is configured to *not* fsync() on all Append() calls
I20260806 00:56:25.407929 25534 tablet_bootstrap.cc:492] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 00:56:25.408270 25534 tablet_bootstrap.cc:492] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Bootstrap complete.
Aug 06 00:56:25 dist-test-slave-44d2 krb5kdc[24622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977785, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:56:25.409701 25534 ts_tablet_manager.cc:1397] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.010s
I20260806 00:56:25.410234 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 25481
I20260806 00:56:25.410619 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:44343
--local_ip_for_outbound_sockets=127.3.98.130
--tserver_master_addrs=127.3.98.190:44213
--webserver_port=39747
--webserver_interface=127.3.98.130
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:56:25.413033 25534 raft_consensus.cc:348] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:25.413463 25534 raft_consensus.cc:729] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb853cbcef664d5eb745ee8dd81a3dbb, State: Initialized, Role: FOLLOWER
I20260806 00:56:25.413681 25534 consensus_queue.cc:260] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:25.414031 25534 ts_tablet_manager.cc:1428] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260806 00:56:25.414821 25693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.402869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:46361)
0806 00:56:25.403162 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:25.403211 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:25.403647 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:25.404182 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:25.404186 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:25.404538 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:56:25.404805 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.404810 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.406231 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.406233 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.407085 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.407088 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.407743 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.407745 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.407892 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.408540 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:56:25.408556 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:56:25.410107 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:56:25.412891 (+ 2784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:25.412900 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:25.412903 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:25.413251 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:25.413568 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:25.413569 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:25.413570 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:25.413707 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:25.414202 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:56:25.414209 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:56:25.414378 (+ 169us) client_negotiation.cc:769] Sending connection context
0806 00:56:25.414472 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 00:56:25.414632 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":106,"threads_started":1}
I20260806 00:56:25.415422 25695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.402954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:46361 (local address 127.3.98.190:44213)
0806 00:56:25.403812 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:25.403820 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:25.403846 (+ 26us) server_negotiation.cc:407] Connection header received
0806 00:56:25.403950 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:25.403954 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:25.403995 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:25.404149 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:56:25.404931 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.406083 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.407201 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.407611 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.407750 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.410269 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:56:25.410274 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:56:25.410274 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:56:25.410288 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:56:25.412775 (+ 2487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:25.413358 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:25.413361 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:25.413362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:25.413488 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:25.413788 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:25.413789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:25.413789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:25.414109 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:56:25.415003 (+ 894us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:25.415098 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 00:56:25.415243 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":812,"thread_start_us":88,"threads_started":1}
I20260806 00:56:25.416046 25691 heartbeater.cc:347] Connected to a master server at 127.3.98.190:44213
I20260806 00:56:25.416177 25691 heartbeater.cc:464] Registering TS with master...
I20260806 00:56:25.416356 25691 heartbeater.cc:511] Master 127.3.98.190:44213 requested a full tablet report, sending...
I20260806 00:56:25.417127 25426 ts_manager.cc:194] Registered new tserver with Master: fb853cbcef664d5eb745ee8dd81a3dbb (127.3.98.129:33855)
I20260806 00:56:25.418260 25426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:46361
I20260806 00:56:25.419348 25691 heartbeater.cc:503] Master 127.3.98.190:44213 was elected leader, sending a full tablet report...
Aug 06 00:56:25 dist-test-slave-44d2 krb5kdc[24622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977785, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for kudu/127.3.98.129@KRBTEST.COM
I20260806 00:56:25.426723 25703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.417954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38924 (local address 127.3.98.129:33855)
0806 00:56:25.418831 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:25.418835 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:25.418844 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:56:25.418875 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:25.418877 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:25.418913 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:25.418976 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:56:25.419582 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.420536 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.421352 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.421655 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.421739 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.423741 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:56:25.423750 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:56:25.423750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:56:25.423757 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:56:25.425375 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:25.425834 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:25.425837 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:25.425837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:25.425899 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:25.426111 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:25.426112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:25.426113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:25.426250 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:56:25.426342 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:25.426542 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 00:56:25.426626 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":844,"thread_start_us":66,"threads_started":1}
I20260806 00:56:25.426731 25701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.417716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:33855 (local address 127.0.0.1:38924)
0806 00:56:25.418606 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:25.418642 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:25.418701 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:25.419006 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:25.419011 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:25.419382 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:56:25.419442 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.419445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.420632 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.420633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.421257 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.421259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.421738 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.421739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.421819 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.422317 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:56:25.422329 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:56:25.423638 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:56:25.425492 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:25.425499 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:25.425501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:25.425730 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:25.425972 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:25.425973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:25.425974 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:25.426043 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:25.426335 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:56:25.426342 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:56:25.426395 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 00:56:25.426490 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 00:56:25.426626 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":862,"thread_start_us":90,"threads_started":1}
I20260806 00:56:25.427403 25594 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6c1739837c4ac5b1262dfe19c3731d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:56:05 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:38924
I20260806 00:56:25.427920 25705 tablet_replica.cc:330] stopping tablet replica
I20260806 00:56:25.428048 25705 raft_consensus.cc:2229] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:56:25.428134 25705 raft_consensus.cc:2258] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:56:25.428455 25705 ts_tablet_manager.cc:1905] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:56:25.430826 25705 ts_tablet_manager.cc:1918] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:56:25.430927 25705 log.cc:1196] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal/wals/cb6c1739837c4ac5b1262dfe19c3731d
I20260806 00:56:25.431174 25705 ts_tablet_manager.cc:1939] T cb6c1739837c4ac5b1262dfe19c3731d P fb853cbcef664d5eb745ee8dd81a3dbb: Deleting consensus metadata
I20260806 00:56:25.431708 25407 catalog_manager.cc:4841] TS fb853cbcef664d5eb745ee8dd81a3dbb (127.3.98.129:33855): tablet cb6c1739837c4ac5b1262dfe19c3731d (table test-table [id=3a0592fa53454712a3abbbd1031f1e2d]) successfully deleted
W20260806 00:56:25.499341 25697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:56:25.499545 25697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:56:25.499569 25697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:56:25.500728 25697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:56:25.500770 25697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:56:25.500795 25697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:56:25.502230 25697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:44343
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=39747
--tserver_master_addrs=127.3.98.190:44213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:56:25.502462 25697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:56:25.502691 25697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:56:25.507728 25711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:25.507761 25714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:25.507736 25710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:25.507879 25697 server_base.cc:1034] running on GCE node
I20260806 00:56:25.508127 25697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:56:25.508374 25697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:56:25.509568 25697 hybrid_clock.cc:648] HybridClock initialized: now 1785977785509558 us; error 40 us; skew 500 ppm
Aug 06 00:56:25 dist-test-slave-44d2 krb5kdc[24622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977785, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:56:25.512146 25697 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:56:25.512706 25697 webserver.cc:460] Webserver started at http://127.3.98.130:39747/ using document root <none> and password file <none>
I20260806 00:56:25.512933 25697 fs_manager.cc:359] Metadata directory not provided
I20260806 00:56:25.513024 25697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:56:25.514384 25697 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:56:25.515072 25729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:25.515242 25697 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:56:25.515338 25697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "e2a07666977047339a9f6f352eff9234"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "52ac237c990cad036cd7c97f71c79941"
server_key_iv: "bb5507bb5e7c0b6167b0f9ec83671367"
server_key_version: "encryptionkey@0"
I20260806 00:56:25.515697 25697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:56:25.522981 25697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:56:25.524849 25697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:56:25.525019 25697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:56:25.525259 25697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:56:25.525570 25697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:56:25.525624 25697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:25.525658 25697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:56:25.525686 25697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:25.532269 25697 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:44343
I20260806 00:56:25.532335 25892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:44343 every 8 connection(s)
I20260806 00:56:25.532752 25697 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:56:25.538388 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 25697
I20260806 00:56:25.538712 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:38299
--local_ip_for_outbound_sockets=127.3.98.131
--tserver_master_addrs=127.3.98.190:44213
--webserver_port=43117
--webserver_interface=127.3.98.131
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 00:56:25 dist-test-slave-44d2 krb5kdc[24622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977785, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:56:25.542843 25695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.533554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:38077 (local address 127.3.98.190:44213)
0806 00:56:25.533602 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:25.533607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:25.533812 (+ 205us) server_negotiation.cc:407] Connection header received
0806 00:56:25.534302 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:25.534302 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:25.534315 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:25.534372 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:56:25.535264 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.535749 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.536865 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.537173 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.537249 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.539605 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:56:25.539607 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:56:25.539607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:56:25.539616 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:56:25.541281 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:25.541860 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:25.541860 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:25.541861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:25.541915 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:25.542199 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:25.542200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:25.542200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:25.542301 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:56:25.542351 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:25.542699 (+ 348us) server_negotiation.cc:299] Negotiation successful
0806 00:56:25.542775 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 00:56:25.543136 25896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.533536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:38077)
0806 00:56:25.533700 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:25.533742 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:25.534217 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:25.534424 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:25.534427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:25.535000 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:56:25.535191 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.535195 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.535831 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.535832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.536781 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.536784 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.537259 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.537260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.537356 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.537885 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:56:25.537893 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:56:25.539441 (+ 1548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:56:25.541369 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:25.541377 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:25.541380 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:25.541779 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:25.541985 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:25.541986 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:25.541987 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:25.542134 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:25.542364 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:56:25.542371 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:56:25.542564 (+ 193us) client_negotiation.cc:769] Sending connection context
0806 00:56:25.542680 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 00:56:25.542860 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":94,"threads_started":1}
I20260806 00:56:25.543742 25893 heartbeater.cc:347] Connected to a master server at 127.3.98.190:44213
I20260806 00:56:25.543856 25893 heartbeater.cc:464] Registering TS with master...
I20260806 00:56:25.544051 25893 heartbeater.cc:511] Master 127.3.98.190:44213 requested a full tablet report, sending...
I20260806 00:56:25.544554 25426 ts_manager.cc:194] Registered new tserver with Master: e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343)
I20260806 00:56:25.544956 25426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:38077
W20260806 00:56:25.623489 25897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:56:25.623690 25897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:56:25.623713 25897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:56:25.624902 25897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:56:25.624976 25897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:56:25.625007 25897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:56:25.626636 25897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:38299
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=43117
--tserver_master_addrs=127.3.98.190:44213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:56:25.626878 25897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:56:25.627122 25897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:56:25.632467 25904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:25.632436 25903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:25.632426 25906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:25.632718 25897 server_base.cc:1034] running on GCE node
I20260806 00:56:25.632939 25897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:56:25.633198 25897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:56:25.634339 25897 hybrid_clock.cc:648] HybridClock initialized: now 1785977785634331 us; error 31 us; skew 500 ppm
Aug 06 00:56:25 dist-test-slave-44d2 krb5kdc[24622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977785, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:56:25.636826 25897 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:56:25.637248 25897 webserver.cc:460] Webserver started at http://127.3.98.131:43117/ using document root <none> and password file <none>
I20260806 00:56:25.637483 25897 fs_manager.cc:359] Metadata directory not provided
I20260806 00:56:25.637574 25897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:56:25.638908 25897 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:56:25.639537 25915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:25.639714 25897 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:25.639820 25897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "311678ef8a90499a8264a6d30b5b5a5e"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "38ca325554b36a36c60449ffc448beb1"
server_key_iv: "1bc35114c01139ae697687127e69ef92"
server_key_version: "encryptionkey@0"
I20260806 00:56:25.640182 25897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:56:25.653640 25897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:56:25.655552 25897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:56:25.655737 25897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:56:25.655982 25897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:56:25.656309 25897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:56:25.656365 25897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:25.656409 25897 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:56:25.656437 25897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:25.662560 25897 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:38299
I20260806 00:56:25.662624 26069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:38299 every 8 connection(s)
I20260806 00:56:25.662998 25897 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:56:25.665567 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 25897
Aug 06 00:56:25 dist-test-slave-44d2 krb5kdc[24622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977785, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:56:25.673565 26074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.666031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60560 (local address 127.3.98.190:44213)
0806 00:56:25.666322 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:25.666324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:25.666370 (+ 46us) server_negotiation.cc:407] Connection header received
0806 00:56:25.666392 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:25.666393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:25.666403 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:25.666467 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:56:25.667224 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.667945 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.668901 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.669244 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.669308 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.670544 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:56:25.670546 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:56:25.670546 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:56:25.670553 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:56:25.672279 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:25.672730 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:25.672731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:25.672731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:25.672805 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:25.673014 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:25.673015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:25.673016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:25.673146 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:56:25.673336 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:25.673375 (+ 39us) server_negotiation.cc:299] Negotiation successful
0806 00:56:25.673454 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":65,"threads_started":1}
I20260806 00:56:25.674367 25695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.663824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:42903 (local address 127.3.98.190:44213)
0806 00:56:25.663919 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:25.663922 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:25.664122 (+ 200us) server_negotiation.cc:407] Connection header received
0806 00:56:25.664770 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:25.664771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:25.664790 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:25.664863 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:56:25.666238 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.667100 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.668440 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.668755 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.668834 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.671204 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:56:25.671206 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:56:25.671206 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:56:25.671213 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:56:25.672823 (+ 1610us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:25.673251 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:25.673252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:25.673253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:25.673314 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:25.673608 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:25.673609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:25.673610 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:25.673748 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:56:25.673825 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:25.674226 (+ 401us) server_negotiation.cc:299] Negotiation successful
0806 00:56:25.674312 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 00:56:25.674618 26072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.663769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:42903)
0806 00:56:25.663985 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:25.664026 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:25.664637 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:25.664973 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:25.664977 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:25.665829 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:56:25.666137 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.666144 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.667211 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.667212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.668359 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.668362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.668837 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.668838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.668986 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.669588 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:56:25.669597 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:56:25.671105 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:56:25.672920 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:25.672927 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:25.672930 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:25.673170 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:25.673385 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:25.673386 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:25.673387 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:25.673507 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:25.673855 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:56:25.673863 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:56:25.674047 (+ 184us) client_negotiation.cc:769] Sending connection context
0806 00:56:25.674177 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 00:56:25.674354 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":110,"threads_started":1}
I20260806 00:56:25.675055 26070 heartbeater.cc:347] Connected to a master server at 127.3.98.190:44213
I20260806 00:56:25.675141 26070 heartbeater.cc:464] Registering TS with master...
I20260806 00:56:25.675293 26070 heartbeater.cc:511] Master 127.3.98.190:44213 requested a full tablet report, sending...
I20260806 00:56:25.675683 25426 ts_manager.cc:194] Registered new tserver with Master: 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299)
I20260806 00:56:25.676051 25426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:42903
I20260806 00:56:25.685540 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:56:25.688176 25695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.685969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60566 (local address 127.3.98.190:44213)
0806 00:56:25.686027 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:25.686029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:25.686143 (+ 114us) server_negotiation.cc:407] Connection header received
0806 00:56:25.686209 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:25.686209 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:25.686247 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:25.686309 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:56:25.686415 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.686872 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.687615 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.687787 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.687836 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.687973 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:56:25.688017 (+ 44us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 00:56:25.688129 (+ 112us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60566: token expired
Metrics: {"server-negotiator.queue_time_us":36}
W20260806 00:56:25.688251 25695 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60566: token expired
W20260806 00:56:25.689247 25326 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.3.98.190:44213)
I20260806 00:56:25.695443 25695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.689506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60578 (local address 127.3.98.190:44213)
0806 00:56:25.689668 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:25.689670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:25.689726 (+ 56us) server_negotiation.cc:407] Connection header received
0806 00:56:25.689801 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:25.689802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:25.689812 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:25.689866 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:56:25.690435 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.690892 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.691583 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.691782 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.691859 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.693074 (+ 1215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:56:25.693075 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:56:25.693076 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:56:25.693083 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:56:25.694309 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:25.694678 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:25.694679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:25.694679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:25.694744 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:25.694945 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:25.694946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:25.694946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:25.695061 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:56:25.695165 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:25.695267 (+ 102us) server_negotiation.cc:299] Negotiation successful
0806 00:56:25.695347 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260806 00:56:25.696787 25426 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60578:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:56:25.698426 25426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:56:25.700892 25594 tablet_service.cc:1467] Processing CreateTablet for tablet 6e02160d917b48b18873578ce80be686 (DEFAULT_TABLE table=test-table [id=064168d06a0a4dfc850db855b0b18990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:56:25.701124 25594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e02160d917b48b18873578ce80be686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:56:25.702698 25534 tablet_bootstrap.cc:492] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb: Bootstrap starting.
I20260806 00:56:25.703034 25534 tablet_bootstrap.cc:654] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb: Neither blocks nor log segments found. Creating new log.
I20260806 00:56:25.704037 25534 tablet_bootstrap.cc:492] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb: No bootstrap required, opened a new log
I20260806 00:56:25.704087 25534 ts_tablet_manager.cc:1397] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 00:56:25.704224 25534 raft_consensus.cc:348] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:25.704288 25534 raft_consensus.cc:374] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:56:25.704329 25534 raft_consensus.cc:729] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb853cbcef664d5eb745ee8dd81a3dbb, State: Initialized, Role: FOLLOWER
I20260806 00:56:25.704378 25534 consensus_queue.cc:260] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:25.704555 25701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.700364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:44343 (local address 127.0.0.1:50470)
0806 00:56:25.700400 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:25.700410 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:25.700458 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:25.700922 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:25.700923 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:25.700925 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:56:25.700967 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.700968 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.702297 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.702298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.703242 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.703245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.704273 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.704274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.704325 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.704339 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 00:56:25.704416 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 00:56:25.704459 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19,"mutex_wait_us":7}
I20260806 00:56:25.704583 26081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.700509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50470 (local address 127.3.98.130:44343)
0806 00:56:25.700723 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:25.700728 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:25.700738 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:56:25.700782 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:25.700784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:25.700799 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:25.700901 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:56:25.701055 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.702194 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.703347 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.704099 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.704172 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.704232 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:25.704433 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 00:56:25.704473 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":99,"threads_started":1}
I20260806 00:56:25.704895 26077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.700428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:38299 (local address 127.0.0.1:44556)
0806 00:56:25.700651 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:25.700661 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:25.700712 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:25.701283 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:25.701284 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:25.701287 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:56:25.701334 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.701336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.702501 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.702502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.703591 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.703594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.704635 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.704636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.704710 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.704714 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:56:25.704774 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 00:56:25.704820 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":147,"threads_started":1}
I20260806 00:56:25.704958 26083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.700609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44556 (local address 127.3.98.131:38299)
0806 00:56:25.701065 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:25.701070 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:25.701080 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:56:25.701120 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:25.701122 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:25.701138 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:25.701213 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:56:25.701420 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.702410 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.703691 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.704426 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.704536 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.704597 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:25.704829 (+ 232us) server_negotiation.cc:299] Negotiation successful
0806 00:56:25.704874 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":84,"threads_started":1}
I20260806 00:56:25.705405 25806 tablet_service.cc:1467] Processing CreateTablet for tablet 6e02160d917b48b18873578ce80be686 (DEFAULT_TABLE table=test-table [id=064168d06a0a4dfc850db855b0b18990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:56:25.705534 25983 tablet_service.cc:1467] Processing CreateTablet for tablet 6e02160d917b48b18873578ce80be686 (DEFAULT_TABLE table=test-table [id=064168d06a0a4dfc850db855b0b18990]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:56:25.705736 25806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e02160d917b48b18873578ce80be686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:56:25.705832 25983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e02160d917b48b18873578ce80be686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:56:25.708547 26085 tablet_bootstrap.cc:492] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234: Bootstrap starting.
I20260806 00:56:25.708864 26086 tablet_bootstrap.cc:492] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e: Bootstrap starting.
I20260806 00:56:25.704468 25534 ts_tablet_manager.cc:1428] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:25.709371 26085 tablet_bootstrap.cc:654] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234: Neither blocks nor log segments found. Creating new log.
I20260806 00:56:25.709492 26086 tablet_bootstrap.cc:654] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e: Neither blocks nor log segments found. Creating new log.
I20260806 00:56:25.709950 26085 log.cc:824] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234: Log is configured to *not* fsync() on all Append() calls
I20260806 00:56:25.710175 26086 log.cc:824] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e: Log is configured to *not* fsync() on all Append() calls
I20260806 00:56:25.710762 26085 tablet_bootstrap.cc:492] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234: No bootstrap required, opened a new log
I20260806 00:56:25.710850 26085 ts_tablet_manager.cc:1397] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:56:25.710956 26086 tablet_bootstrap.cc:492] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e: No bootstrap required, opened a new log
I20260806 00:56:25.711026 26086 ts_tablet_manager.cc:1397] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:56:25.712428 26085 raft_consensus.cc:348] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:25.712668 26085 raft_consensus.cc:374] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:56:25.712723 26085 raft_consensus.cc:729] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2a07666977047339a9f6f352eff9234, State: Initialized, Role: FOLLOWER
I20260806 00:56:25.712641 26086 raft_consensus.cc:348] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:25.712826 26086 raft_consensus.cc:374] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:56:25.712874 26086 raft_consensus.cc:729] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 311678ef8a90499a8264a6d30b5b5a5e, State: Initialized, Role: FOLLOWER
I20260806 00:56:25.712848 26085 consensus_queue.cc:260] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:25.713004 26086 consensus_queue.cc:260] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:25.713148 25893 heartbeater.cc:503] Master 127.3.98.190:44213 was elected leader, sending a full tablet report...
I20260806 00:56:25.713155 26085 ts_tablet_manager.cc:1428] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 00:56:25.713285 26086 ts_tablet_manager.cc:1428] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 00:56:25.713289 26070 heartbeater.cc:503] Master 127.3.98.190:44213 was elected leader, sending a full tablet report...
I20260806 00:56:25.748447 26092 raft_consensus.cc:482] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:56:25.748670 26092 raft_consensus.cc:504] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:25.749090 26092 leader_election.cc:288] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343), fb853cbcef664d5eb745ee8dd81a3dbb (127.3.98.129:33855)
I20260806 00:56:25.752048 26081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.749355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:54191 (local address 127.3.98.130:44343)
0806 00:56:25.749416 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:25.749418 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:25.749425 (+ 7us) server_negotiation.cc:407] Connection header received
0806 00:56:25.749452 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:25.749453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:25.749462 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:25.749521 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:56:25.749696 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.750312 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.751311 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.751687 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.751778 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.751787 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:25.751942 (+ 155us) server_negotiation.cc:299] Negotiation successful
0806 00:56:25.751987 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 00:56:25.752048 26072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.749256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:44343 (local address 127.3.98.131:54191)
0806 00:56:25.749312 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:25.749326 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:25.749373 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:25.749535 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:25.749536 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:25.749538 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:56:25.749615 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.749617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.750403 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.750405 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.751219 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.751221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.751777 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.751778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.751863 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.751866 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:56:25.751934 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 00:56:25.751974 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260806 00:56:25.752358 26094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.749285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:33855 (local address 127.3.98.131:52729)
0806 00:56:25.749458 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:25.749468 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:25.749559 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:25.749780 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:25.749781 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:25.749782 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:56:25.749855 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.749860 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.750532 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.750534 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.751452 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:25.751455 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.752082 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.752083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:25.752159 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.752165 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 00:56:25.752248 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 00:56:25.752283 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":119,"threads_started":1}
I20260806 00:56:25.752424 25703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.749349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:52729 (local address 127.3.98.129:33855)
0806 00:56:25.749401 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:25.749403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:25.749546 (+ 143us) server_negotiation.cc:407] Connection header received
0806 00:56:25.749636 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:25.749638 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:25.749671 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:25.749738 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:56:25.749937 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.750435 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.751550 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.751979 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.752075 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.752156 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:25.752297 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 00:56:25.752351 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 00:56:25.752514 25828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e02160d917b48b18873578ce80be686" candidate_uuid: "311678ef8a90499a8264a6d30b5b5a5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a07666977047339a9f6f352eff9234" is_pre_election: true
I20260806 00:56:25.752673 25828 raft_consensus.cc:2454] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 311678ef8a90499a8264a6d30b5b5a5e in term 0.
I20260806 00:56:25.752686 25626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e02160d917b48b18873578ce80be686" candidate_uuid: "311678ef8a90499a8264a6d30b5b5a5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" is_pre_election: true
I20260806 00:56:25.752835 25626 raft_consensus.cc:2454] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 311678ef8a90499a8264a6d30b5b5a5e in term 0.
I20260806 00:56:25.752918 25916 leader_election.cc:302] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 311678ef8a90499a8264a6d30b5b5a5e, e2a07666977047339a9f6f352eff9234; no voters:
I20260806 00:56:25.753115 26092 raft_consensus.cc:2781] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:56:25.753175 26092 raft_consensus.cc:482] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:56:25.753206 26092 raft_consensus.cc:3037] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:56:25.753911 26092 raft_consensus.cc:504] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:25.754071 26092 leader_election.cc:288] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [CANDIDATE]: Term 1 election: Requested vote from peers e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343), fb853cbcef664d5eb745ee8dd81a3dbb (127.3.98.129:33855)
I20260806 00:56:25.754246 25626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e02160d917b48b18873578ce80be686" candidate_uuid: "311678ef8a90499a8264a6d30b5b5a5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb"
I20260806 00:56:25.754268 25828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e02160d917b48b18873578ce80be686" candidate_uuid: "311678ef8a90499a8264a6d30b5b5a5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2a07666977047339a9f6f352eff9234"
I20260806 00:56:25.754336 25626 raft_consensus.cc:3037] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:56:25.754335 25828 raft_consensus.cc:3037] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:56:25.755242 25626 raft_consensus.cc:2454] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 311678ef8a90499a8264a6d30b5b5a5e in term 1.
I20260806 00:56:25.755242 25828 raft_consensus.cc:2454] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 311678ef8a90499a8264a6d30b5b5a5e in term 1.
I20260806 00:56:25.755451 25918 leader_election.cc:302] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 311678ef8a90499a8264a6d30b5b5a5e, fb853cbcef664d5eb745ee8dd81a3dbb; no voters:
I20260806 00:56:25.755533 26092 raft_consensus.cc:2781] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:56:25.755686 26092 raft_consensus.cc:686] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [term 1 LEADER]: Becoming Leader. State: Replica: 311678ef8a90499a8264a6d30b5b5a5e, State: Running, Role: LEADER
I20260806 00:56:25.755793 26092 consensus_queue.cc:237] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:25.756685 25424 catalog_manager.cc:5495] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e reported cstate change: term changed from 0 to 1, leader changed from <none> to 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131). New cstate: current_term: 1 leader_uuid: "311678ef8a90499a8264a6d30b5b5a5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } health_report { overall_health: UNKNOWN } } }
I20260806 00:56:25.761886 26083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:25.759678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44562 (local address 127.3.98.131:38299)
0806 00:56:25.759725 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:25.759727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:25.759735 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:56:25.759792 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:25.759792 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:25.759807 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:25.759865 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:56:25.759940 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.760404 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.761133 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:25.761310 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:25.761385 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:25.761557 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:56:25.761645 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:56:25.761701 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:25.761770 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 00:56:25.761786 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:56:25.764051 25626 raft_consensus.cc:1261] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Refusing update from remote peer 311678ef8a90499a8264a6d30b5b5a5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:56:25.764051 25828 raft_consensus.cc:1261] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234 [term 1 FOLLOWER]: Refusing update from remote peer 311678ef8a90499a8264a6d30b5b5a5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:56:25.764472 26092 consensus_queue.cc:1035] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:56:25.764642 26096 consensus_queue.cc:1035] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:56:25.767299 26102 mvcc.cc:205] Tried to move back new op lower bound from 7315365010486407168 to 7315365010456444928. Current Snapshot: MvccSnapshot[applied={T|T < 7315365010486407168}]
I20260806 00:56:25.767964 26101 mvcc.cc:205] Tried to move back new op lower bound from 7315365010486407168 to 7315365010456444928. Current Snapshot: MvccSnapshot[applied={T|T < 7315365010486407168 or (T in {7315365010486407168})}]
I20260806 00:56:25.769316 25424 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:56:25.769407 25424 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60578:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:56:25.770150 25424 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Sending DeleteTablet for 3 replicas of tablet 6e02160d917b48b18873578ce80be686
I20260806 00:56:25.770490 25983 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e02160d917b48b18873578ce80be686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:56:25 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:44556
I20260806 00:56:25.770515 25806 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e02160d917b48b18873578ce80be686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:56:25 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:50470
I20260806 00:56:25.770726 26110 tablet_replica.cc:330] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e: stopping tablet replica
I20260806 00:56:25.770706 25594 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e02160d917b48b18873578ce80be686 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:56:25 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:38924
I20260806 00:56:25.770799 25705 tablet_replica.cc:330] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb: stopping tablet replica
I20260806 00:56:25.770828 26110 raft_consensus.cc:2229] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:56:25.770848 25705 raft_consensus.cc:2229] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:56:25.770901 25705 raft_consensus.cc:2258] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:56:25.770928 26110 raft_consensus.cc:2258] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:56:25.771171 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 25481
I20260806 00:56:25.771335 25705 ts_tablet_manager.cc:1905] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:56:25.773571 26111 tablet_replica.cc:330] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234: stopping tablet replica
I20260806 00:56:25.773681 26111 raft_consensus.cc:2229] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:56:25.773787 26111 raft_consensus.cc:2258] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:56:25.774246 26111 ts_tablet_manager.cc:1905] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:56:25.776232 26111 ts_tablet_manager.cc:1918] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:56:25.776312 26111 log.cc:1196] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/6e02160d917b48b18873578ce80be686
I20260806 00:56:25.776662 26111 ts_tablet_manager.cc:1939] T 6e02160d917b48b18873578ce80be686 P e2a07666977047339a9f6f352eff9234: Deleting consensus metadata
I20260806 00:56:25.777211 25405 catalog_manager.cc:4841] TS e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343): tablet 6e02160d917b48b18873578ce80be686 (table test-table [id=064168d06a0a4dfc850db855b0b18990]) successfully deleted
I20260806 00:56:25.777545 26110 ts_tablet_manager.cc:1905] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:56:25.779188 26110 ts_tablet_manager.cc:1918] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:56:25.779284 26110 log.cc:1196] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/6e02160d917b48b18873578ce80be686
I20260806 00:56:25.779623 26110 ts_tablet_manager.cc:1939] T 6e02160d917b48b18873578ce80be686 P 311678ef8a90499a8264a6d30b5b5a5e: Deleting consensus metadata
W20260806 00:56:25.779713 25407 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:33855 (error 108)
I20260806 00:56:25.779990 25407 catalog_manager.cc:4841] TS 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299): tablet 6e02160d917b48b18873578ce80be686 (table test-table [id=064168d06a0a4dfc850db855b0b18990]) successfully deleted
W20260806 00:56:25.781277 26077 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:56:25.780176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:33855 (local address 127.0.0.1:38932)
0806 00:56:25.780253 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:25.780268 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:25.780321 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:25.781229 (+ 908us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:33855: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":48}
W20260806 00:56:25.781402 25407 catalog_manager.cc:4584] TS fb853cbcef664d5eb745ee8dd81a3dbb (127.3.98.129:33855): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6e02160d917b48b18873578ce80be686: Network error: Client connection negotiation failed: client connection to 127.3.98.129:33855: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 00:56:25.782050 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 25697
I20260806 00:56:25.790928 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 25897
I20260806 00:56:25.801219 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 25384
I20260806 00:56:45.810379 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44213
--webserver_interface=127.3.98.190
--webserver_port=38031
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:44213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:56:45.899437 26113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:56:45.899662 26113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:56:45.899686 26113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:56:45.901050 26113 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 00:56:45.901104 26113 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 00:56:45.901120 26113 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 00:56:45.901134 26113 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:56:45.901190 26113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:56:45.901212 26113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:56:45.901242 26113 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:56:45.901281 26113 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:56:45.902813 26113 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:44213
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=38031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:56:45.903071 26113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:56:45.903314 26113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:56:45.908674 26123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:45.908676 26125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:45.908711 26113 server_base.cc:1034] running on GCE node
W20260806 00:56:45.908715 26122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:45.909202 26113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:56:45.909507 26113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:56:45.910701 26113 hybrid_clock.cc:648] HybridClock initialized: now 1785977805910689 us; error 32 us; skew 500 ppm
Aug 06 00:56:45 dist-test-slave-44d2 krb5kdc[24622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977805, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:56:45.919229 26113 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:56:45.919701 26113 webserver.cc:460] Webserver started at http://127.3.98.190:38031/ using document root <none> and password file <none>
I20260806 00:56:45.919940 26113 fs_manager.cc:359] Metadata directory not provided
I20260806 00:56:45.920011 26113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:56:45.921514 26113 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:56:45.922304 26135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:45.922554 26113 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:56:45.922678 26113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "f182ce0c659d40df904514e93e48a729"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "6a45846cc81b4dda054126a27e289d2d"
server_key_iv: "3eb91a297104a41169181d31c1752544"
server_key_version: "encryptionkey@0"
I20260806 00:56:45.923043 26113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:56:45.932862 26113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:56:45.934783 26113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:56:45.934958 26113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:56:45.939139 26113 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:44213
I20260806 00:56:45.939177 26212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:44213 every 8 connection(s)
I20260806 00:56:45.939556 26113 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:56:45.941254 26213 sys_catalog.cc:263] Verifying existing consensus state
I20260806 00:56:45.941963 26213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Bootstrap starting.
I20260806 00:56:45.947161 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 26113
I20260806 00:56:45.947466 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:33855
--local_ip_for_outbound_sockets=127.3.98.129
--tserver_master_addrs=127.3.98.190:44213
--webserver_port=39781
--webserver_interface=127.3.98.129
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:56:45.951797 26213 log.cc:824] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Log is configured to *not* fsync() on all Append() calls
I20260806 00:56:45.954206 26213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 00:56:45.954536 26213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Bootstrap complete.
I20260806 00:56:45.956961 26213 raft_consensus.cc:348] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } }
I20260806 00:56:45.957217 26213 raft_consensus.cc:729] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f182ce0c659d40df904514e93e48a729, State: Initialized, Role: FOLLOWER
I20260806 00:56:45.957394 26213 consensus_queue.cc:260] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } }
I20260806 00:56:45.957479 26213 raft_consensus.cc:388] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:56:45.957535 26213 raft_consensus.cc:482] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:56:45.957612 26213 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 2 FOLLOWER]: Advancing to term 3
I20260806 00:56:45.958639 26213 raft_consensus.cc:504] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } }
I20260806 00:56:45.958765 26213 leader_election.cc:302] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f182ce0c659d40df904514e93e48a729; no voters:
I20260806 00:56:45.958978 26213 leader_election.cc:288] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 00:56:45.959014 26217 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 00:56:45.959138 26217 raft_consensus.cc:686] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [term 3 LEADER]: Becoming Leader. State: Replica: f182ce0c659d40df904514e93e48a729, State: Running, Role: LEADER
I20260806 00:56:45.959275 26213 sys_catalog.cc:564] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:56:45.959304 26217 consensus_queue.cc:237] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } }
I20260806 00:56:45.959755 26218 sys_catalog.cc:455] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "f182ce0c659d40df904514e93e48a729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } } }
I20260806 00:56:45.959844 26218 sys_catalog.cc:458] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: This master's current role is: LEADER
I20260806 00:56:45.960085 26219 sys_catalog.cc:455] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f182ce0c659d40df904514e93e48a729. Latest consensus state: current_term: 3 leader_uuid: "f182ce0c659d40df904514e93e48a729" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f182ce0c659d40df904514e93e48a729" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44213 } } }
I20260806 00:56:45.960197 26219 sys_catalog.cc:458] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729 [sys.catalog]: This master's current role is: LEADER
I20260806 00:56:45.960135 26228 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:56:45.961090 26228 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:56:45.961329 26228 catalog_manager.cc:1259] Loaded cluster ID: 0936893be23c489eabd6f87901ff72ef
I20260806 00:56:45.961447 26228 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:56:45.962675 26228 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:56:45.962862 26228 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Loaded TSK: 0
I20260806 00:56:45.962908 26228 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f182ce0c659d40df904514e93e48a729: Loaded TSK: 1
F20260806 00:56:45.963148 26228 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fb86d5909ad google::LogMessage::Fail() at ??:0
@ 0x7fb86d59388a google::LogMessage::SendToLog() at ??:0
@ 0x7fb86d5904de google::LogMessage::Flush() at ??:0
@ 0x7fb86d591a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fb86fcfd104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fb86fcfad41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fb8754ea1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fb8754ea48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fb8754ea594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fb8754b0c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fb8754baad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fb86f45e0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fb86f453954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fb8702b76db start_thread at ??:0
@ 0x7fb86c08e61f clone at ??:0
W20260806 00:56:46.071655 26215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:56:46.071942 26215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:56:46.071982 26215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:56:46.073735 26215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:56:46.073804 26215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:56:46.073846 26215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:56:46.076154 26215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:33855
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=39781
--tserver_master_addrs=127.3.98.190:44213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:56:46.076437 26215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:56:46.076761 26215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 00:56:46.082345 26215 server_base.cc:1034] running on GCE node
W20260806 00:56:46.082437 26269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:46.082293 26266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:46.082309 26267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:46.082777 26215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:56:46.083038 26215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:56:46.084205 26215 hybrid_clock.cc:648] HybridClock initialized: now 1785977806084190 us; error 31 us; skew 500 ppm
Aug 06 00:56:46 dist-test-slave-44d2 krb5kdc[24622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977806, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:56:46.086963 26215 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:56:46.087391 26215 webserver.cc:460] Webserver started at http://127.3.98.129:39781/ using document root <none> and password file <none>
I20260806 00:56:46.087651 26215 fs_manager.cc:359] Metadata directory not provided
I20260806 00:56:46.087728 26215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:56:46.089221 26215 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:56:46.090061 26280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:46.090253 26215 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:56:46.090349 26215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "fb853cbcef664d5eb745ee8dd81a3dbb"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "c28e885df9a5db974a48e21e7125f171"
server_key_iv: "9988c95b8193428a34ddbc49e3ba9f73"
server_key_version: "encryptionkey@0"
I20260806 00:56:46.090709 26215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:56:46.122496 26215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:56:46.125092 26215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:56:46.125278 26215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:56:46.125555 26215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:56:46.126091 26290 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 00:56:46.128284 26215 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 00:56:46.128350 26215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 00:56:46.128399 26215 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 00:56:46.129117 26215 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 00:56:46.129177 26215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260806 00:56:46.129261 26290 tablet_bootstrap.cc:492] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb: Bootstrap starting.
I20260806 00:56:46.131372 26290 log.cc:824] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb: Log is configured to *not* fsync() on all Append() calls
I20260806 00:56:46.134617 26290 tablet_bootstrap.cc:492] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 00:56:46.134951 26290 tablet_bootstrap.cc:492] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb: Bootstrap complete.
I20260806 00:56:46.135119 26290 ts_tablet_manager.cc:1397] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260806 00:56:46.136893 26215 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:33855
I20260806 00:56:46.136924 26441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:33855 every 8 connection(s)
I20260806 00:56:46.137280 26215 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:56:46.137166 26290 raft_consensus.cc:348] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:46.137576 26290 raft_consensus.cc:729] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb853cbcef664d5eb745ee8dd81a3dbb, State: Initialized, Role: FOLLOWER
I20260806 00:56:46.137905 26290 consensus_queue.cc:260] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:46.138216 26290 ts_tablet_manager.cc:1428] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
I20260806 00:56:46.144950 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 26215
I20260806 00:56:46.145257 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:44343
--local_ip_for_outbound_sockets=127.3.98.130
--tserver_master_addrs=127.3.98.190:44213
--webserver_port=39747
--webserver_interface=127.3.98.130
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:56:46.196089 26446 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:56:46.138177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:42149)
0806 00:56:46.138390 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:46.138436 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:46.138590 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:46.195836 (+ 57246us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":99,"threads_started":1}
W20260806 00:56:46.196408 26443 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:44213 (0 consecutive failures): Network error: Failed to ping master at 127.3.98.190:44213: Client connection negotiation failed: client connection to 127.3.98.190:44213: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 00:56:46.196820 26446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:46.196674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:43479)
0806 00:56:46.196738 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:46.196789 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 00:56:46.197311 26446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:46.197206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:35905)
0806 00:56:46.197257 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:46.197288 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 00:56:46.197454 26443 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 00:56:46.234932 26447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:56:46.235147 26447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:56:46.235172 26447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:56:46.236264 26447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:56:46.236306 26447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:56:46.236337 26447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:56:46.237807 26447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:44343
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=39747
--tserver_master_addrs=127.3.98.190:44213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:56:46.238004 26447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:56:46.238186 26447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:56:46.243162 26460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:46.243191 26457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:46.243177 26455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:46.243556 26447 server_base.cc:1034] running on GCE node
I20260806 00:56:46.243757 26447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:56:46.243997 26447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:56:46.245170 26447 hybrid_clock.cc:648] HybridClock initialized: now 1785977806245172 us; error 46 us; skew 500 ppm
Aug 06 00:56:46 dist-test-slave-44d2 krb5kdc[24622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977806, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:56:46.247713 26447 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:56:46.248109 26447 webserver.cc:460] Webserver started at http://127.3.98.130:39747/ using document root <none> and password file <none>
I20260806 00:56:46.248291 26447 fs_manager.cc:359] Metadata directory not provided
I20260806 00:56:46.248332 26447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:56:46.249764 26447 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:56:46.250384 26469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:46.250548 26447 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:56:46.250662 26447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "e2a07666977047339a9f6f352eff9234"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "52ac237c990cad036cd7c97f71c79941"
server_key_iv: "bb5507bb5e7c0b6167b0f9ec83671367"
server_key_version: "encryptionkey@0"
I20260806 00:56:46.251081 26447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:56:46.264227 26447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:56:46.266132 26447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:56:46.266247 26447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:56:46.266433 26447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:56:46.266682 26447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:56:46.266716 26447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:46.266737 26447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:56:46.266749 26447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:46.272812 26447 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:44343
I20260806 00:56:46.272979 26626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:44343 every 8 connection(s)
I20260806 00:56:46.273253 26447 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:56:46.274312 26631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:46.273917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:46009)
0806 00:56:46.274087 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:46.274167 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":76,"threads_started":1}
W20260806 00:56:46.274780 26628 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:44213 (0 consecutive failures): Network error: Failed to ping master at 127.3.98.190:44213: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
I20260806 00:56:46.275087 26631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:46.274990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:59793)
0806 00:56:46.275037 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:46.275068 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260806 00:56:46.275415 26631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:46.275320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:41531)
0806 00:56:46.275375 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:46.275399 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 00:56:46.275552 26628 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 00:56:46.282686 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 26447
I20260806 00:56:46.282999 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:38299
--local_ip_for_outbound_sockets=127.3.98.131
--tserver_master_addrs=127.3.98.190:44213
--webserver_port=43117
--webserver_interface=127.3.98.131
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:56:46.369423 26632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:56:46.369630 26632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:56:46.369654 26632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:56:46.370781 26632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:56:46.370822 26632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:56:46.370849 26632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:56:46.372308 26632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:38299
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=43117
--tserver_master_addrs=127.3.98.190:44213
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:56:46.372601 26632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:56:46.372830 26632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:56:46.377780 26644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:56:46.377811 26639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:46.377976 26632 server_base.cc:1034] running on GCE node
W20260806 00:56:46.378037 26640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:56:46.378247 26632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:56:46.378504 26632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:56:46.379699 26632 hybrid_clock.cc:648] HybridClock initialized: now 1785977806379695 us; error 40 us; skew 500 ppm
Aug 06 00:56:46 dist-test-slave-44d2 krb5kdc[24622](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977806, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:56:46.382321 26632 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:56:46.382807 26632 webserver.cc:460] Webserver started at http://127.3.98.131:43117/ using document root <none> and password file <none>
I20260806 00:56:46.383051 26632 fs_manager.cc:359] Metadata directory not provided
I20260806 00:56:46.383100 26632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:56:46.384423 26632 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:56:46.385087 26655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:46.385275 26632 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:46.385360 26632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "311678ef8a90499a8264a6d30b5b5a5e"
format_stamp: "Formatted at 2026-08-06 00:56:04 on dist-test-slave-44d2"
server_key: "38ca325554b36a36c60449ffc448beb1"
server_key_iv: "1bc35114c01139ae697687127e69ef92"
server_key_version: "encryptionkey@0"
I20260806 00:56:46.385675 26632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:56:46.395351 26632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:56:46.397217 26632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:56:46.397325 26632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:56:46.397496 26632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:56:46.397796 26632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:56:46.397830 26632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:46.397851 26632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:56:46.397900 26632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:56:46.403616 26632 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:38299
I20260806 00:56:46.403697 26814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:38299 every 8 connection(s)
I20260806 00:56:46.404079 26632 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:56:46.405154 26819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:46.404773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:45195)
0806 00:56:46.404930 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:46.404997 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
W20260806 00:56:46.405550 26815 heartbeater.cc:644] Failed to heartbeat to 127.3.98.190:44213 (0 consecutive failures): Network error: Failed to ping master at 127.3.98.190:44213: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
I20260806 00:56:46.405843 26819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:46.405743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:43819)
0806 00:56:46.405794 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:46.405824 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 00:56:46.406170 26819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:46.406078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:35347)
0806 00:56:46.406123 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:46.406147 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 00:56:46.406272 26815 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 00:56:46.409149 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 26632
I20260806 00:56:47.198117 26822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:47.197848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:46935)
0806 00:56:47.198009 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:47.198051 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":93,"threads_started":1}
I20260806 00:56:47.276163 26823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:47.275935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:34161)
0806 00:56:47.276074 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:47.276108 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":67,"threads_started":1}
I20260806 00:56:47.286285 26824 raft_consensus.cc:482] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:56:47.286398 26824 raft_consensus.cc:504] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:47.286780 26824 leader_election.cc:288] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343), 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299)
Aug 06 00:56:47 dist-test-slave-44d2 krb5kdc[24622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977806, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.130@KRBTEST.COM
Aug 06 00:56:47 dist-test-slave-44d2 krb5kdc[24622](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977806, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.131@KRBTEST.COM
I20260806 00:56:47.298635 26826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:47.287183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:38997 (local address 127.3.98.131:38299)
0806 00:56:47.287366 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:47.287379 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:47.287405 (+ 26us) server_negotiation.cc:407] Connection header received
0806 00:56:47.287963 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:47.287966 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:47.288052 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:47.288200 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:56:47.289318 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:47.290656 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:47.291451 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:47.291879 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:47.292013 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:47.295102 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:56:47.295105 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:56:47.295105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:56:47.295115 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:56:47.297068 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:47.297423 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:47.297425 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:47.297426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:47.297508 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:47.297739 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:47.297739 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:47.297740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:47.298021 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:56:47.298100 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:47.298372 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 00:56:47.298515 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":76,"threads_started":1}
I20260806 00:56:47.298631 26827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:47.287209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:56455 (local address 127.3.98.130:44343)
0806 00:56:47.287366 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 00:56:47.287379 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 00:56:47.287410 (+ 31us) server_negotiation.cc:407] Connection header received
0806 00:56:47.287964 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:56:47.287967 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:56:47.288029 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:56:47.288200 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:56:47.288988 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:47.290476 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:47.291463 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:56:47.291879 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:56:47.292010 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:47.294649 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:56:47.294654 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:56:47.294654 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:56:47.294666 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:56:47.296758 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:47.297199 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:47.297202 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:47.297202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:47.297292 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:56:47.297565 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:56:47.297567 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:56:47.297567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:56:47.297919 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:56:47.298009 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 00:56:47.298372 (+ 363us) server_negotiation.cc:299] Negotiation successful
0806 00:56:47.298515 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":58,"threads_started":1}
I20260806 00:56:47.298653 26825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:47.286935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:38299 (local address 127.3.98.129:38997)
0806 00:56:47.287230 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:47.287241 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:47.287284 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:47.288330 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:47.288331 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:47.289086 (+ 755us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:56:47.289162 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:47.289165 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:47.290747 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:47.290748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:47.291361 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:47.291363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:47.291982 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:47.291983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:47.292116 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:47.292904 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:56:47.292909 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:56:47.294959 (+ 2050us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:56:47.297149 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:47.297150 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:47.297151 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:47.297340 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:47.297624 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:47.297624 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:47.297624 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:47.297673 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:47.298088 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:56:47.298088 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:56:47.298169 (+ 81us) client_negotiation.cc:769] Sending connection context
0806 00:56:47.298291 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 00:56:47.298498 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":22,"thread_start_us":84,"threads_started":1}
I20260806 00:56:47.298653 26822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:47.286935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:44343 (local address 127.3.98.129:56455)
0806 00:56:47.286985 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:47.286999 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 00:56:47.287088 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:56:47.288267 (+ 1179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:56:47.288270 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:56:47.288637 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:56:47.288853 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:47.288859 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:47.290573 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:47.290573 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:47.291364 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:56:47.291365 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:56:47.291980 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:56:47.291982 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:56:47.292115 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:56:47.292867 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:56:47.292875 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:56:47.294514 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:56:47.296842 (+ 2328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:47.296849 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:47.296851 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:47.297081 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:47.297360 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:56:47.297361 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:56:47.297361 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:56:47.297492 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:56:47.297992 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:56:47.297999 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:56:47.298169 (+ 170us) client_negotiation.cc:769] Sending connection context
0806 00:56:47.298291 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 00:56:47.298552 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":133}
W20260806 00:56:47.299779 26285 leader_election.cc:341] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299): Not found: Tablet not found: 6e02160d917b48b18873578ce80be686
W20260806 00:56:47.299973 26282 leader_election.cc:341] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343): Not found: Tablet not found: 6e02160d917b48b18873578ce80be686
I20260806 00:56:47.300015 26282 leader_election.cc:302] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb853cbcef664d5eb745ee8dd81a3dbb; no voters: 311678ef8a90499a8264a6d30b5b5a5e, e2a07666977047339a9f6f352eff9234
I20260806 00:56:47.300132 26824 raft_consensus.cc:2726] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 00:56:47.406803 26828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:47.406583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:33917)
0806 00:56:47.406715 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:47.406763 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
I20260806 00:56:48.198791 26831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:48.198546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:49699)
0806 00:56:48.198705 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:48.198742 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":78,"threads_started":1}
I20260806 00:56:48.276979 26832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:48.276730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:53367)
0806 00:56:48.276898 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:48.276937 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":67,"threads_started":1}
I20260806 00:56:48.407498 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:48.407271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:47769)
0806 00:56:48.407417 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:48.407456 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":66,"threads_started":1}
I20260806 00:56:49.199484 26835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:49.199261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:43323)
0806 00:56:49.199395 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:49.199435 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":64,"threads_started":1}
I20260806 00:56:49.277638 26836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:49.277436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:41241)
0806 00:56:49.277562 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:49.277597 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260806 00:56:49.293040 26837 raft_consensus.cc:482] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:56:49.293144 26837 raft_consensus.cc:504] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:49.293319 26837 leader_election.cc:288] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343), 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299)
W20260806 00:56:49.293773 26282 leader_election.cc:341] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343): Not found: Tablet not found: 6e02160d917b48b18873578ce80be686
W20260806 00:56:49.293905 26285 leader_election.cc:341] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299): Not found: Tablet not found: 6e02160d917b48b18873578ce80be686
I20260806 00:56:49.293939 26285 leader_election.cc:302] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb853cbcef664d5eb745ee8dd81a3dbb; no voters: 311678ef8a90499a8264a6d30b5b5a5e, e2a07666977047339a9f6f352eff9234
I20260806 00:56:49.294044 26837 raft_consensus.cc:2726] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 00:56:49.408208 26838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:49.407993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:58151)
0806 00:56:49.408126 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:49.408165 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":68,"threads_started":1}
I20260806 00:56:50.200209 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:50.199972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:37009)
0806 00:56:50.200118 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:50.200159 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":70,"threads_started":1}
I20260806 00:56:50.278527 26841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:50.278323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:59013)
0806 00:56:50.278449 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:50.278485 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
I20260806 00:56:50.408987 26842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:50.408750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:50345)
0806 00:56:50.408905 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:50.408944 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":61,"threads_started":1}
I20260806 00:56:51.036691 26844 raft_consensus.cc:482] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:56:51.036793 26844 raft_consensus.cc:504] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:51.036963 26844 leader_election.cc:288] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343), 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299)
W20260806 00:56:51.037341 26282 leader_election.cc:341] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343): Not found: Tablet not found: 6e02160d917b48b18873578ce80be686
W20260806 00:56:51.037446 26285 leader_election.cc:341] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299): Not found: Tablet not found: 6e02160d917b48b18873578ce80be686
I20260806 00:56:51.037562 26285 leader_election.cc:302] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb853cbcef664d5eb745ee8dd81a3dbb; no voters: 311678ef8a90499a8264a6d30b5b5a5e, e2a07666977047339a9f6f352eff9234
I20260806 00:56:51.037662 26844 raft_consensus.cc:2726] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 00:56:51.201041 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:51.200778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:46229)
0806 00:56:51.200940 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:51.200987 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":71,"threads_started":1}
I20260806 00:56:51.279196 26846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:51.278967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:48097)
0806 00:56:51.279113 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:51.279150 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":79,"threads_started":1}
I20260806 00:56:51.409691 26848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:51.409464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:54399)
0806 00:56:51.409609 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:51.409648 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
I20260806 00:56:52.201752 26849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:52.201515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:43845)
0806 00:56:52.201664 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:52.201701 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":67,"threads_started":1}
I20260806 00:56:52.279913 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:52.279681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:46443)
0806 00:56:52.279831 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:52.279870 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":84,"threads_started":1}
I20260806 00:56:52.410465 26853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:52.410181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:33329)
0806 00:56:52.410372 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:52.410420 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":96,"threads_started":1}
I20260806 00:56:53.202626 26854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:53.202351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:53487)
0806 00:56:53.202509 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:53.202558 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":76,"threads_started":1}
I20260806 00:56:53.280860 26855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:53.280458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:58197)
0806 00:56:53.280761 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:53.280813 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":128,"threads_started":1}
I20260806 00:56:53.411329 26856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:53.411073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:40653)
0806 00:56:53.411233 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:53.411282 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":69,"threads_started":1}
I20260806 00:56:54.203366 26858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:54.203103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:52607)
0806 00:56:54.203276 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:54.203317 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":70,"threads_started":1}
I20260806 00:56:54.281634 26859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:54.281379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:33631)
0806 00:56:54.281541 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:54.281584 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":69,"threads_started":1}
I20260806 00:56:54.412081 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:54.411839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:55287)
0806 00:56:54.411990 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:54.412034 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":81,"threads_started":1}
I20260806 00:56:55.204113 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:55.203868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:54305)
0806 00:56:55.204019 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:55.204049 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":96,"threads_started":1}
I20260806 00:56:55.282431 26863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:55.282235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:46953)
0806 00:56:55.282353 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:55.282385 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":64,"threads_started":1}
I20260806 00:56:55.412842 26864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:55.412617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:54115)
0806 00:56:55.412755 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:55.412795 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":78,"threads_started":1}
I20260806 00:56:55.879974 26866 raft_consensus.cc:482] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:56:55.880075 26866 raft_consensus.cc:504] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2a07666977047339a9f6f352eff9234" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 44343 } } peers { permanent_uuid: "311678ef8a90499a8264a6d30b5b5a5e" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38299 } } peers { permanent_uuid: "fb853cbcef664d5eb745ee8dd81a3dbb" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 33855 } }
I20260806 00:56:55.880264 26866 leader_election.cc:288] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343), 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299)
W20260806 00:56:55.880684 26285 leader_election.cc:341] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 311678ef8a90499a8264a6d30b5b5a5e (127.3.98.131:38299): Not found: Tablet not found: 6e02160d917b48b18873578ce80be686
W20260806 00:56:55.880791 26282 leader_election.cc:341] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e2a07666977047339a9f6f352eff9234 (127.3.98.130:44343): Not found: Tablet not found: 6e02160d917b48b18873578ce80be686
I20260806 00:56:55.880877 26282 leader_election.cc:302] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb853cbcef664d5eb745ee8dd81a3dbb; no voters: 311678ef8a90499a8264a6d30b5b5a5e, e2a07666977047339a9f6f352eff9234
I20260806 00:56:55.880956 26866 raft_consensus.cc:2726] T 6e02160d917b48b18873578ce80be686 P fb853cbcef664d5eb745ee8dd81a3dbb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 00:56:56.205183 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:56.204838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:35629)
0806 00:56:56.205075 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:56.205129 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":103,"threads_started":1}
I20260806 00:56:56.283223 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:56.282965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:34381)
0806 00:56:56.283122 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:56.283175 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260806 00:56:56.413667 26869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:56.413390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:59381)
0806 00:56:56.413567 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:56.413618 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":72,"threads_started":1}
I20260806 00:56:57.205952 26870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:57.205731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:59707)
0806 00:56:57.205863 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:57.205903 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
I20260806 00:56:57.283938 26871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:57.283723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:36673)
0806 00:56:57.283854 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:57.283889 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260806 00:56:57.414446 26872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:57.414154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:56153)
0806 00:56:57.414317 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:57.414393 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":70,"threads_started":1}
I20260806 00:56:58.206743 26873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:58.206532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:52371)
0806 00:56:58.206662 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:58.206694 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
I20260806 00:56:58.284780 26875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:58.284561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:48745)
0806 00:56:58.284692 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:58.284733 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":64,"threads_started":1}
I20260806 00:56:58.415141 26876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:58.414930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:54989)
0806 00:56:58.415059 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:58.415095 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260806 00:56:59.207525 26877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:59.207286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:47305)
0806 00:56:59.207437 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:59.207479 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":65,"threads_started":1}
I20260806 00:56:59.285601 26878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:59.285308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:43505)
0806 00:56:59.285472 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:59.285536 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":102,"threads_started":1}
I20260806 00:56:59.415782 26879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:56:59.415578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:48565)
0806 00:56:59.415703 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0806 00:56:59.415738 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260806 00:57:00.208289 26880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:00.208068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:37459)
0806 00:57:00.208205 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:00.208241 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260806 00:57:00.286393 26881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:00.286123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:57697)
0806 00:57:00.286281 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:00.286325 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":82,"threads_started":1}
I20260806 00:57:00.416647 26883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:00.416375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:48607)
0806 00:57:00.416548 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:00.416595 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":66,"threads_started":1}
I20260806 00:57:01.209265 26884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:01.208791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.129:45219)
0806 00:57:01.208941 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:01.208984 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":81,"threads_started":1}
I20260806 00:57:01.287289 26885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:01.287049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.130:35699)
0806 00:57:01.287198 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:01.287239 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
I20260806 00:57:01.417426 26886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:01.417181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:44213 (local address 127.3.98.131:33849)
0806 00:57:01.417335 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:01.417377 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.190:44213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":83,"threads_started":1}
I20260806 00:57:01.418857 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 26215
I20260806 00:57:01.436467 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 26447
I20260806 00:57:01.446163 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 26632
2026-08-06T00:57:01Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58540 ms)
[----------] 30 tests from SecurityITest (242129 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:01 dist-test-slave-44d2 krb5kdc[26892](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:01 dist-test-slave-44d2 krb5kdc[26892](info): set up 2 sockets
Aug 06 00:57:01 dist-test-slave-44d2 krb5kdc[26892](info): commencing operation
krb5kdc: starting...
W20260806 00:57:02.728370 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:02 dist-test-slave-44d2 krb5kdc[26892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:57:02.855574 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:35321
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:35321
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:02.938804 26912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:02.939060 26912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:02.939101 26912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:02.940243 26912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:02.940311 26912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:02.940335 26912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:02.940357 26912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:02.940409 26912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:02.941900 26912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:35321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:35321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:02.942174 26912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:02.942395 26912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 00:57:02.947665 26912 server_base.cc:1034] running on GCE node
W20260806 00:57:02.947635 26918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:02.947649 26919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:02.947647 26922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:02.948139 26912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:02.948421 26912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:02.949582 26912 hybrid_clock.cc:648] HybridClock initialized: now 1785977822949568 us; error 32 us; skew 500 ppm
Aug 06 00:57:02 dist-test-slave-44d2 krb5kdc[26892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977822, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:02.952224 26912 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:57:02.952739 26912 webserver.cc:460] Webserver started at http://127.3.98.190:45795/ using document root <none> and password file <none>
I20260806 00:57:02.952993 26912 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:02.953060 26912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:02.953204 26912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:02.954254 26912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "88195dc1e6c640458856f148d209e098"
format_stamp: "Formatted at 2026-08-06 00:57:02 on dist-test-slave-44d2"
server_key: "b76935625dd09060f93d5989368f5e89"
server_key_iv: "fb04237dad11bebb08627bc6ad6d5caa"
server_key_version: "encryptionkey@0"
I20260806 00:57:02.954617 26912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "88195dc1e6c640458856f148d209e098"
format_stamp: "Formatted at 2026-08-06 00:57:02 on dist-test-slave-44d2"
server_key: "b76935625dd09060f93d5989368f5e89"
server_key_iv: "fb04237dad11bebb08627bc6ad6d5caa"
server_key_version: "encryptionkey@0"
I20260806 00:57:02.955963 26912 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:02.956790 26934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:02.957027 26912 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:02.957121 26912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "88195dc1e6c640458856f148d209e098"
format_stamp: "Formatted at 2026-08-06 00:57:02 on dist-test-slave-44d2"
server_key: "b76935625dd09060f93d5989368f5e89"
server_key_iv: "fb04237dad11bebb08627bc6ad6d5caa"
server_key_version: "encryptionkey@0"
I20260806 00:57:02.957201 26912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:02.970443 26912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:02.972371 26912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:02.972558 26912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:02.977031 26912 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:35321
I20260806 00:57:02.977069 27001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:35321 every 8 connection(s)
I20260806 00:57:02.977448 26912 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:02.978464 27002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:02.980798 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 26912
I20260806 00:57:02.980937 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:02.981143 27002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098: Bootstrap starting.
I20260806 00:57:02.981170 3466 external_mini_cluster.cc:1428] Setting key 9d431f4877faba4ad31773a31ca574a3
I20260806 00:57:02.981922 27002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:02.982246 27002 log.cc:824] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:02.983115 27002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098: No bootstrap required, opened a new log
I20260806 00:57:02.985543 27002 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88195dc1e6c640458856f148d209e098" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35321 } }
I20260806 00:57:02.985725 27002 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:02.985770 27002 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88195dc1e6c640458856f148d209e098, State: Initialized, Role: FOLLOWER
I20260806 00:57:02.985967 27002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88195dc1e6c640458856f148d209e098" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35321 } }
I20260806 00:57:02.986070 27002 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:02.986117 27002 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:02.986167 27002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:02.986891 27002 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88195dc1e6c640458856f148d209e098" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35321 } }
I20260806 00:57:02.987017 27002 leader_election.cc:302] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88195dc1e6c640458856f148d209e098; no voters:
I20260806 00:57:02.987202 27002 leader_election.cc:288] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:02.987262 27012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:02.987437 27012 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [term 1 LEADER]: Becoming Leader. State: Replica: 88195dc1e6c640458856f148d209e098, State: Running, Role: LEADER
I20260806 00:57:02.987488 27002 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:02.987641 27012 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88195dc1e6c640458856f148d209e098" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35321 } }
Aug 06 00:57:02 dist-test-slave-44d2 krb5kdc[26892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:02.988888 27013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88195dc1e6c640458856f148d209e098. Latest consensus state: current_term: 1 leader_uuid: "88195dc1e6c640458856f148d209e098" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88195dc1e6c640458856f148d209e098" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35321 } } }
I20260806 00:57:02.988982 27013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:02.989369 27014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88195dc1e6c640458856f148d209e098" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88195dc1e6c640458856f148d209e098" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35321 } } }
I20260806 00:57:02.989476 27014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098 [sys.catalog]: This master's current role is: LEADER
W20260806 00:57:02.989665 27037 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 00:57:02.989760 27037 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:57:02.989866 27038 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:02.990099 27038 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:02.992539 27038 catalog_manager.cc:1347] Generated new cluster ID: 95f7ddd04a15423682097b6fa3b88baf
I20260806 00:57:02.992606 27038 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:02.994134 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:02.981730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52302 (local address 127.3.98.190:35321)
0806 00:57:02.981922 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:02.981930 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:02.981955 (+ 25us) server_negotiation.cc:407] Connection header received
0806 00:57:02.982647 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:02.982658 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:02.982728 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:02.982865 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:02.983695 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:02.984663 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:02.985822 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:02.986395 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:02.986485 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:02.989734 (+ 3249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:02.989739 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:02.989739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:02.989753 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:02.992325 (+ 2572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:02.992814 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:02.992818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:02.992818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:02.992938 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:02.993165 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:02.993166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:02.993167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:02.993501 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:02.993673 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:02.993765 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 00:57:02.993912 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":85,"threads_started":1}
I20260806 00:57:02.995886 27038 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:02.996340 27038 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:03.006387 27038 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098: Generated new TSK 0
I20260806 00:57:03.006596 27038 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:57:03.039168 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35321
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:03.126163 27043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:03.126374 27043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:03.126399 27043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:03.127575 27043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:03.127619 27043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:03.127646 27043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:57:03.129217 27043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:03.129468 27043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:03.129711 27043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:03.134867 27053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:03.134863 27054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:03.135036 27043 server_base.cc:1034] running on GCE node
W20260806 00:57:03.135035 27059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:03.135326 27043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:03.135572 27043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:03.136711 27043 hybrid_clock.cc:648] HybridClock initialized: now 1785977823136690 us; error 35 us; skew 500 ppm
Aug 06 00:57:03 dist-test-slave-44d2 krb5kdc[26892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977823, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:03.139539 27043 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:57:03.139991 27043 webserver.cc:460] Webserver started at http://127.3.98.129:37645/ using document root <none> and password file <none>
I20260806 00:57:03.140252 27043 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:03.140301 27043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:03.140462 27043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:03.141582 27043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "e9af95b533174182bab67dd3a9ab8085"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "3183edd0e974bffb5d9b72c768abaaa9"
server_key_iv: "8afdd82218703c2d3a07538a00610029"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.141965 27043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "e9af95b533174182bab67dd3a9ab8085"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "3183edd0e974bffb5d9b72c768abaaa9"
server_key_iv: "8afdd82218703c2d3a07538a00610029"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.143347 27043 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:03.144212 27068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:03.144402 27043 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:03.144518 27043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "e9af95b533174182bab67dd3a9ab8085"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "3183edd0e974bffb5d9b72c768abaaa9"
server_key_iv: "8afdd82218703c2d3a07538a00610029"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.144596 27043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:03.162663 27043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:03.164695 27043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:03.164814 27043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:03.165017 27043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:03.165385 27043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:03.165422 27043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:03.165465 27043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:03.165491 27043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:03.171680 27043 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:38975
I20260806 00:57:03.171764 27230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:38975 every 8 connection(s)
I20260806 00:57:03.172106 27043 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:57:03.175302 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 27043
I20260806 00:57:03.175406 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:57:03.175655 3466 external_mini_cluster.cc:1428] Setting key 1ba9c7fac35e95d177b158ed42818083
Aug 06 00:57:03 dist-test-slave-44d2 krb5kdc[26892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977823, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:03.182626 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.173027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:52935 (local address 127.3.98.190:35321)
0806 00:57:03.173079 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:03.173081 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:03.173227 (+ 146us) server_negotiation.cc:407] Connection header received
0806 00:57:03.173736 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:03.173737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:03.173749 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:03.173818 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:03.174831 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.175522 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.176981 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.177188 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.177246 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.179722 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:03.179724 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:03.179724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:03.179732 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:03.181185 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:03.181622 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:03.181623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:03.181623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:03.181681 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:03.181936 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:03.181937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:03.181937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:03.182051 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:03.182143 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:03.182424 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 00:57:03.182530 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 00:57:03.182809 27233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.172916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35321 (local address 127.3.98.129:52935)
0806 00:57:03.173096 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:03.173140 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:03.173636 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:03.173874 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:03.173877 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:03.174469 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:03.174704 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.174709 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.175643 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.175644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.176898 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.176902 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.177274 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.177275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.177433 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.177999 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:03.178011 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:03.179615 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:03.181278 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:03.181285 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:03.181287 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:03.181521 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:03.181755 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:03.181756 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:03.181756 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:03.181872 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:03.182133 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:03.182141 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:03.182287 (+ 146us) client_negotiation.cc:769] Sending connection context
0806 00:57:03.182390 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 00:57:03.182553 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":98,"threads_started":1}
I20260806 00:57:03.183444 27231 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35321
I20260806 00:57:03.183588 27231 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:03.183779 27231 heartbeater.cc:511] Master 127.3.98.190:35321 requested a full tablet report, sending...
I20260806 00:57:03.184361 26960 ts_manager.cc:194] Registered new tserver with Master: e9af95b533174182bab67dd3a9ab8085 (127.3.98.129:38975)
I20260806 00:57:03.185003 26960 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:52935
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:57:03.204166 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35321
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:03.288321 27237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:03.288604 27237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:03.288628 27237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:03.289805 27237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:03.289857 27237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:03.289884 27237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:57:03.291286 27237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:03.291476 27237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:03.291658 27237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:03.296747 27246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:03.296746 27248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:03.296814 27237 server_base.cc:1034] running on GCE node
W20260806 00:57:03.296722 27245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:03.297097 27237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:03.297346 27237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:03.298506 27237 hybrid_clock.cc:648] HybridClock initialized: now 1785977823298501 us; error 40 us; skew 500 ppm
Aug 06 00:57:03 dist-test-slave-44d2 krb5kdc[26892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977823, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:03.301066 27237 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:57:03.301467 27237 webserver.cc:460] Webserver started at http://127.3.98.130:34367/ using document root <none> and password file <none>
I20260806 00:57:03.301659 27237 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:03.301700 27237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:03.301792 27237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:03.302784 27237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "f3c4c1d4cb66429b8f906fe859d4a975"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "b41129224972f2ae464e2150e3626114"
server_key_iv: "8d37c52e480300887427be7da9c85c16"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.303102 27237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "f3c4c1d4cb66429b8f906fe859d4a975"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "b41129224972f2ae464e2150e3626114"
server_key_iv: "8d37c52e480300887427be7da9c85c16"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.304376 27237 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 00:57:03.305218 27257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:03.305433 27237 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:03.305536 27237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "f3c4c1d4cb66429b8f906fe859d4a975"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "b41129224972f2ae464e2150e3626114"
server_key_iv: "8d37c52e480300887427be7da9c85c16"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.305594 27237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:03.315395 27237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:03.318012 27237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:03.318145 27237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:03.318343 27237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:03.318667 27237 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:03.318701 27237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:03.318725 27237 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:03.318740 27237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:03.324937 27237 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:39939
I20260806 00:57:03.324994 27426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:39939 every 8 connection(s)
I20260806 00:57:03.325358 27237 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:57:03.329681 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 27237
I20260806 00:57:03.329833 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:57:03.330080 3466 external_mini_cluster.cc:1428] Setting key 9e3b03086358d8846c640b7ac9484b3e
Aug 06 00:57:03 dist-test-slave-44d2 krb5kdc[26892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977823, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:03.335799 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.326220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:35059 (local address 127.3.98.190:35321)
0806 00:57:03.326312 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:03.326315 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:03.326478 (+ 163us) server_negotiation.cc:407] Connection header received
0806 00:57:03.326956 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:03.326957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:03.326970 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:03.327038 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:03.327998 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.328636 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.329639 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.330105 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.330195 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.332532 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:03.332533 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:03.332533 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:03.332542 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:03.334158 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:03.334664 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:03.334665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:03.334665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:03.334717 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:03.335089 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:03.335090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:03.335091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:03.335210 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:03.335277 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:03.335648 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 00:57:03.335735 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 00:57:03.336089 27433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.326134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35321 (local address 127.3.98.130:35059)
0806 00:57:03.326342 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:03.326386 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:03.326869 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:03.327114 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:03.327118 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:03.327708 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:03.327906 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.327911 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.328714 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.328715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.329531 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.329533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.330222 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.330223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.330333 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.330944 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:03.330953 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:03.332413 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:03.334242 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:03.334249 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:03.334252 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:03.334580 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:03.334779 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:03.334780 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:03.334781 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:03.334931 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:03.335293 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:03.335302 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:03.335483 (+ 181us) client_negotiation.cc:769] Sending connection context
0806 00:57:03.335611 (+ 128us) client_negotiation.cc:240] Negotiation successful
0806 00:57:03.335803 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":123,"threads_started":1}
I20260806 00:57:03.336673 27429 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35321
I20260806 00:57:03.336787 27429 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:03.336999 27429 heartbeater.cc:511] Master 127.3.98.190:35321 requested a full tablet report, sending...
I20260806 00:57:03.337406 26960 ts_manager.cc:194] Registered new tserver with Master: f3c4c1d4cb66429b8f906fe859d4a975 (127.3.98.130:39939)
I20260806 00:57:03.337770 26960 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:35059
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:57:03.358866 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35321
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:03.443142 27437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:03.443368 27437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:03.443409 27437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:03.444599 27437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:03.444659 27437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:03.444705 27437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:57:03.446175 27437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35321
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:03.446437 27437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:03.446667 27437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:03.451738 27446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:03.451745 27451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:03.451756 27445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:03.451834 27437 server_base.cc:1034] running on GCE node
I20260806 00:57:03.452157 27437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:03.452394 27437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:03.453557 27437 hybrid_clock.cc:648] HybridClock initialized: now 1785977823453555 us; error 40 us; skew 500 ppm
Aug 06 00:57:03 dist-test-slave-44d2 krb5kdc[26892](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977823, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:03.456017 27437 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:57:03.456440 27437 webserver.cc:460] Webserver started at http://127.3.98.131:35059/ using document root <none> and password file <none>
I20260806 00:57:03.456727 27437 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:03.456796 27437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:03.456939 27437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:03.457988 27437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "c896a31d83e04078adfc8b097706c734"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "8e8ce57b2d4fcd791d7f9c9679316e70"
server_key_iv: "b6b8ebf427d8ef0bd930af6959e049a6"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.458345 27437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "c896a31d83e04078adfc8b097706c734"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "8e8ce57b2d4fcd791d7f9c9679316e70"
server_key_iv: "b6b8ebf427d8ef0bd930af6959e049a6"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.459748 27437 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:03.460557 27461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:03.460758 27437 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:03.460865 27437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "c896a31d83e04078adfc8b097706c734"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "8e8ce57b2d4fcd791d7f9c9679316e70"
server_key_iv: "b6b8ebf427d8ef0bd930af6959e049a6"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.460949 27437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:03.469987 27437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:03.471895 27437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:03.472066 27437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:03.472267 27437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:03.472641 27437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:03.472692 27437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:03.472736 27437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:03.472762 27437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:03.478616 27437 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:41113
I20260806 00:57:03.478690 27629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:41113 every 8 connection(s)
I20260806 00:57:03.479020 27437 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:57:03.484400 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 27437
I20260806 00:57:03.484560 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:57:03.484773 3466 external_mini_cluster.cc:1428] Setting key a4a6cf510765e7533755b6bc531b445a
Aug 06 00:57:03 dist-test-slave-44d2 krb5kdc[26892](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977823, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:03.488178 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.479731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:48535 (local address 127.3.98.190:35321)
0806 00:57:03.479778 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:03.479781 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:03.479989 (+ 208us) server_negotiation.cc:407] Connection header received
0806 00:57:03.480458 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:03.480459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:03.480469 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:03.480574 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:03.481478 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.481984 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.482930 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.483129 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.483186 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.485599 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:03.485601 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:03.485601 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:03.485610 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:03.486852 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:03.487277 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:03.487279 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:03.487279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:03.487352 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:03.487593 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:03.487594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:03.487595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:03.487702 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:03.487755 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:03.488030 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 00:57:03.488113 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:57:03.488337 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.479696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35321 (local address 127.3.98.131:48535)
0806 00:57:03.479857 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:03.479898 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:03.480377 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:03.480640 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:03.480644 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:03.481207 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:03.481400 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.481404 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.482062 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.482063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.482850 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.482852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.483203 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.483204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.483309 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.483758 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:03.483766 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:03.485503 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:03.486919 (+ 1416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:03.486925 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:03.486927 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:03.487151 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:03.487424 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:03.487425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:03.487425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:03.487528 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:03.487756 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:03.487774 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:03.487916 (+ 142us) client_negotiation.cc:769] Sending connection context
0806 00:57:03.488000 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 00:57:03.488126 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":89,"threads_started":1}
I20260806 00:57:03.488847 27630 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35321
I20260806 00:57:03.489012 27630 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:03.489207 27630 heartbeater.cc:511] Master 127.3.98.190:35321 requested a full tablet report, sending...
I20260806 00:57:03.489576 26960 ts_manager.cc:194] Registered new tserver with Master: c896a31d83e04078adfc8b097706c734 (127.3.98.131:41113)
I20260806 00:57:03.489954 26960 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:48535
I20260806 00:57:03.496905 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:57:03.504365 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.498408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52316 (local address 127.3.98.190:35321)
0806 00:57:03.498458 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:03.498460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:03.498511 (+ 51us) server_negotiation.cc:407] Connection header received
0806 00:57:03.498573 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:03.498574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:03.498583 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:03.498640 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:03.499179 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.499756 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.500524 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.500734 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.500791 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.502080 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:03.502082 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:03.502082 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:03.502088 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:03.503387 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:03.503693 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:03.503694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:03.503694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:03.503743 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:03.503935 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:03.503935 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:03.503936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:03.504075 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:03.504158 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:03.504242 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 00:57:03.504302 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 00:57:03.505977 26960 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52316:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:57:03.507880 26960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:57:03.515266 27649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.510447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37990 (local address 127.3.98.129:38975)
0806 00:57:03.510860 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:03.510866 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:03.510875 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:57:03.511002 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:03.511004 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:03.511208 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:03.511317 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:03.511435 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.512592 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.514078 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.514848 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.514919 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.514988 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:03.515137 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 00:57:03.515181 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":97,"threads_started":1}
I20260806 00:57:03.515255 27651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.510326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:38975 (local address 127.0.0.1:37990)
0806 00:57:03.510663 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:03.510675 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:03.510732 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:03.511316 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:03.511317 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:03.511319 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:03.511375 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.511377 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.512734 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.512735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.513983 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.513985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.514931 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.514933 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.515013 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.515028 (+ 15us) client_negotiation.cc:769] Sending connection context
0806 00:57:03.515110 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 00:57:03.515176 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":101,"threads_started":1}
I20260806 00:57:03.515517 27648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.510285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:41113 (local address 127.0.0.1:51156)
0806 00:57:03.510485 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:03.510530 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:03.510605 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:03.511159 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:03.511160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:03.511162 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:03.511222 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.511224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.513625 (+ 2401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.513626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.514467 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.514469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.515270 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.515271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.515333 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.515337 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:57:03.515386 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 00:57:03.515427 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":7,"thread_start_us":62,"threads_started":1}
I20260806 00:57:03.515718 27652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.510512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51156 (local address 127.3.98.131:41113)
0806 00:57:03.510816 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:03.510822 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:03.510834 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:57:03.510955 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:03.510958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:03.510975 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:03.511061 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:03.512584 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.513531 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.514553 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.515120 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.515181 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.515235 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:03.515615 (+ 380us) server_negotiation.cc:299] Negotiation successful
0806 00:57:03.515659 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":125,"threads_started":1}
I20260806 00:57:03.516206 27141 tablet_service.cc:1467] Processing CreateTablet for tablet 480b217b9682477298b51c2bcc15003b (DEFAULT_TABLE table=test-table [id=c5fbe8810907495dae40a917adbbe11a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:03.516603 27647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.510498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:39939 (local address 127.0.0.1:47122)
0806 00:57:03.510757 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:03.510766 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:03.510810 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:03.511130 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:03.511133 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:03.511136 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:03.511223 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.511224 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.513768 (+ 2544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.513769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.514782 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.514785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.516310 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.516312 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.516361 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.516365 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:57:03.516450 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 00:57:03.516513 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":7,"thread_start_us":87,"threads_started":1}
I20260806 00:57:03.516621 27653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.510775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47122 (local address 127.3.98.130:39939)
0806 00:57:03.510949 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:03.510953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:03.510962 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:57:03.511002 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:03.511004 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:03.511020 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:03.511106 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:03.511467 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.513673 (+ 2206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.514890 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.516212 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.516298 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.516354 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:03.516462 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 00:57:03.516525 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":98,"threads_started":1}
I20260806 00:57:03.516660 27141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 480b217b9682477298b51c2bcc15003b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:03.517174 27529 tablet_service.cc:1467] Processing CreateTablet for tablet 480b217b9682477298b51c2bcc15003b (DEFAULT_TABLE table=test-table [id=c5fbe8810907495dae40a917adbbe11a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:03.517372 27332 tablet_service.cc:1467] Processing CreateTablet for tablet 480b217b9682477298b51c2bcc15003b (DEFAULT_TABLE table=test-table [id=c5fbe8810907495dae40a917adbbe11a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:03.517501 27529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 480b217b9682477298b51c2bcc15003b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:03.517700 27332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 480b217b9682477298b51c2bcc15003b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:03.520085 27654 tablet_bootstrap.cc:492] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975: Bootstrap starting.
I20260806 00:57:03.520695 27655 tablet_bootstrap.cc:492] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085: Bootstrap starting.
I20260806 00:57:03.520946 27654 tablet_bootstrap.cc:654] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:03.521098 27656 tablet_bootstrap.cc:492] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734: Bootstrap starting.
I20260806 00:57:03.521411 27655 tablet_bootstrap.cc:654] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:03.521600 27654 log.cc:824] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:03.521718 27656 tablet_bootstrap.cc:654] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:03.521968 27655 log.cc:824] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:03.522356 27656 log.cc:824] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:03.522485 27654 tablet_bootstrap.cc:492] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975: No bootstrap required, opened a new log
I20260806 00:57:03.522557 27654 ts_tablet_manager.cc:1397] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 00:57:03.522765 27655 tablet_bootstrap.cc:492] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085: No bootstrap required, opened a new log
I20260806 00:57:03.522831 27655 ts_tablet_manager.cc:1397] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:57:03.523130 27656 tablet_bootstrap.cc:492] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734: No bootstrap required, opened a new log
I20260806 00:57:03.523188 27656 ts_tablet_manager.cc:1397] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:57:03.524296 27655 raft_consensus.cc:348] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c896a31d83e04078adfc8b097706c734" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 41113 } } peers { permanent_uuid: "f3c4c1d4cb66429b8f906fe859d4a975" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 39939 } } peers { permanent_uuid: "e9af95b533174182bab67dd3a9ab8085" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38975 } }
I20260806 00:57:03.524467 27655 raft_consensus.cc:374] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:03.524581 27655 raft_consensus.cc:729] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9af95b533174182bab67dd3a9ab8085, State: Initialized, Role: FOLLOWER
I20260806 00:57:03.524597 27654 raft_consensus.cc:348] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c896a31d83e04078adfc8b097706c734" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 41113 } } peers { permanent_uuid: "f3c4c1d4cb66429b8f906fe859d4a975" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 39939 } } peers { permanent_uuid: "e9af95b533174182bab67dd3a9ab8085" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38975 } }
I20260806 00:57:03.524703 27655 consensus_queue.cc:260] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c896a31d83e04078adfc8b097706c734" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 41113 } } peers { permanent_uuid: "f3c4c1d4cb66429b8f906fe859d4a975" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 39939 } } peers { permanent_uuid: "e9af95b533174182bab67dd3a9ab8085" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38975 } }
I20260806 00:57:03.524765 27654 raft_consensus.cc:374] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:03.524798 27654 raft_consensus.cc:729] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3c4c1d4cb66429b8f906fe859d4a975, State: Initialized, Role: FOLLOWER
I20260806 00:57:03.524979 27655 ts_tablet_manager.cc:1428] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 00:57:03.524999 27231 heartbeater.cc:503] Master 127.3.98.190:35321 was elected leader, sending a full tablet report...
I20260806 00:57:03.525141 27656 raft_consensus.cc:348] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c896a31d83e04078adfc8b097706c734" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 41113 } } peers { permanent_uuid: "f3c4c1d4cb66429b8f906fe859d4a975" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 39939 } } peers { permanent_uuid: "e9af95b533174182bab67dd3a9ab8085" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38975 } }
I20260806 00:57:03.525295 27656 raft_consensus.cc:374] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:03.525329 27656 raft_consensus.cc:729] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c896a31d83e04078adfc8b097706c734, State: Initialized, Role: FOLLOWER
I20260806 00:57:03.525286 27654 consensus_queue.cc:260] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c896a31d83e04078adfc8b097706c734" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 41113 } } peers { permanent_uuid: "f3c4c1d4cb66429b8f906fe859d4a975" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 39939 } } peers { permanent_uuid: "e9af95b533174182bab67dd3a9ab8085" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38975 } }
I20260806 00:57:03.525444 27656 consensus_queue.cc:260] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c896a31d83e04078adfc8b097706c734" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 41113 } } peers { permanent_uuid: "f3c4c1d4cb66429b8f906fe859d4a975" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 39939 } } peers { permanent_uuid: "e9af95b533174182bab67dd3a9ab8085" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38975 } }
I20260806 00:57:03.525624 27429 heartbeater.cc:503] Master 127.3.98.190:35321 was elected leader, sending a full tablet report...
I20260806 00:57:03.525725 27630 heartbeater.cc:503] Master 127.3.98.190:35321 was elected leader, sending a full tablet report...
I20260806 00:57:03.525966 27654 ts_tablet_manager.cc:1428] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260806 00:57:03.525723 27656 ts_tablet_manager.cc:1428] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:57:03.530695 27664 raft_consensus.cc:482] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:57:03.530771 27664 raft_consensus.cc:504] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c896a31d83e04078adfc8b097706c734" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 41113 } } peers { permanent_uuid: "f3c4c1d4cb66429b8f906fe859d4a975" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 39939 } } peers { permanent_uuid: "e9af95b533174182bab67dd3a9ab8085" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38975 } }
I20260806 00:57:03.531023 27664 leader_election.cc:288] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3c4c1d4cb66429b8f906fe859d4a975 (127.3.98.130:39939), e9af95b533174182bab67dd3a9ab8085 (127.3.98.129:38975)
I20260806 00:57:03.534231 27666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.531183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:39939 (local address 127.3.98.131:56833)
0806 00:57:03.531401 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:03.531411 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:03.531472 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:03.531598 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:03.531598 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:03.531599 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:03.531653 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.531655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.532267 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.532269 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.533167 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.533169 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.534035 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.534036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.534091 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.534095 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:57:03.534141 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 00:57:03.534169 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":59,"thread_start_us":84,"threads_started":1}
I20260806 00:57:03.534303 27653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.531299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:56833 (local address 127.3.98.130:39939)
0806 00:57:03.531347 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:03.531350 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:03.531479 (+ 129us) server_negotiation.cc:407] Connection header received
0806 00:57:03.531514 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:03.531515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:03.531527 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:03.531595 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:03.531722 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.532187 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.533273 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.533946 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.534030 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.534040 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:03.534181 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 00:57:03.534226 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 00:57:03.534590 27358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "480b217b9682477298b51c2bcc15003b" candidate_uuid: "c896a31d83e04078adfc8b097706c734" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c4c1d4cb66429b8f906fe859d4a975" is_pre_election: true
I20260806 00:57:03.534734 27358 raft_consensus.cc:2454] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c896a31d83e04078adfc8b097706c734 in term 0.
I20260806 00:57:03.534786 27632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.531183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:38975 (local address 127.3.98.131:44957)
0806 00:57:03.531242 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:03.531257 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:03.531309 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:03.531583 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:03.531585 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:03.531587 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:03.531657 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.531658 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.532271 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.532272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.533365 (+ 1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.533369 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.534527 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.534529 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.534603 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.534607 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:57:03.534672 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 00:57:03.534716 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":33}
I20260806 00:57:03.534811 27649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.531320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:44957 (local address 127.3.98.129:38975)
0806 00:57:03.531365 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:03.531368 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:03.531377 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:57:03.531404 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:03.531405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:03.531418 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:03.531482 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:03.531729 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.532189 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.533482 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.534253 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.534340 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.534349 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:03.534693 (+ 344us) server_negotiation.cc:299] Negotiation successful
0806 00:57:03.534740 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:57:03.534960 27464 leader_election.cc:302] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c896a31d83e04078adfc8b097706c734, f3c4c1d4cb66429b8f906fe859d4a975; no voters:
I20260806 00:57:03.535113 27664 raft_consensus.cc:2781] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:57:03.535166 27664 raft_consensus.cc:482] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:57:03.535182 27664 raft_consensus.cc:3037] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:03.535153 27165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "480b217b9682477298b51c2bcc15003b" candidate_uuid: "c896a31d83e04078adfc8b097706c734" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9af95b533174182bab67dd3a9ab8085" is_pre_election: true
I20260806 00:57:03.535298 27165 raft_consensus.cc:2454] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c896a31d83e04078adfc8b097706c734 in term 0.
I20260806 00:57:03.535917 27664 raft_consensus.cc:504] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c896a31d83e04078adfc8b097706c734" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 41113 } } peers { permanent_uuid: "f3c4c1d4cb66429b8f906fe859d4a975" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 39939 } } peers { permanent_uuid: "e9af95b533174182bab67dd3a9ab8085" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38975 } }
I20260806 00:57:03.536060 27664 leader_election.cc:288] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [CANDIDATE]: Term 1 election: Requested vote from peers f3c4c1d4cb66429b8f906fe859d4a975 (127.3.98.130:39939), e9af95b533174182bab67dd3a9ab8085 (127.3.98.129:38975)
I20260806 00:57:03.536204 27358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "480b217b9682477298b51c2bcc15003b" candidate_uuid: "c896a31d83e04078adfc8b097706c734" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3c4c1d4cb66429b8f906fe859d4a975"
I20260806 00:57:03.536203 27165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "480b217b9682477298b51c2bcc15003b" candidate_uuid: "c896a31d83e04078adfc8b097706c734" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9af95b533174182bab67dd3a9ab8085"
I20260806 00:57:03.536262 27358 raft_consensus.cc:3037] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:03.536293 27165 raft_consensus.cc:3037] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:03.537014 27358 raft_consensus.cc:2454] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c896a31d83e04078adfc8b097706c734 in term 1.
I20260806 00:57:03.537091 27165 raft_consensus.cc:2454] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c896a31d83e04078adfc8b097706c734 in term 1.
I20260806 00:57:03.537173 27464 leader_election.cc:302] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c896a31d83e04078adfc8b097706c734, f3c4c1d4cb66429b8f906fe859d4a975; no voters:
I20260806 00:57:03.537256 27664 raft_consensus.cc:2781] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:03.537410 27664 raft_consensus.cc:686] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [term 1 LEADER]: Becoming Leader. State: Replica: c896a31d83e04078adfc8b097706c734, State: Running, Role: LEADER
I20260806 00:57:03.537616 27664 consensus_queue.cc:237] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c896a31d83e04078adfc8b097706c734" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 41113 } } peers { permanent_uuid: "f3c4c1d4cb66429b8f906fe859d4a975" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 39939 } } peers { permanent_uuid: "e9af95b533174182bab67dd3a9ab8085" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38975 } }
I20260806 00:57:03.538465 26959 catalog_manager.cc:5495] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 reported cstate change: term changed from 0 to 1, leader changed from <none> to c896a31d83e04078adfc8b097706c734 (127.3.98.131). New cstate: current_term: 1 leader_uuid: "c896a31d83e04078adfc8b097706c734" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c896a31d83e04078adfc8b097706c734" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 41113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3c4c1d4cb66429b8f906fe859d4a975" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 39939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9af95b533174182bab67dd3a9ab8085" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38975 } health_report { overall_health: UNKNOWN } } }
I20260806 00:57:03.543704 27652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.541717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51168 (local address 127.3.98.131:41113)
0806 00:57:03.541767 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:03.541768 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:03.541776 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:57:03.541832 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:03.541832 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:03.541847 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:03.541902 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:03.541994 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.542417 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.543102 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.543272 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.543316 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.543427 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:03.543524 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:03.543580 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:03.543609 (+ 29us) server_negotiation.cc:299] Negotiation successful
0806 00:57:03.543624 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 00:57:03.545333 27165 raft_consensus.cc:1261] T 480b217b9682477298b51c2bcc15003b P e9af95b533174182bab67dd3a9ab8085 [term 1 FOLLOWER]: Refusing update from remote peer c896a31d83e04078adfc8b097706c734: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:03.545346 27358 raft_consensus.cc:1261] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975 [term 1 FOLLOWER]: Refusing update from remote peer c896a31d83e04078adfc8b097706c734: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:03.545630 27664 consensus_queue.cc:1035] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9af95b533174182bab67dd3a9ab8085" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 38975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:03.545753 27668 consensus_queue.cc:1035] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3c4c1d4cb66429b8f906fe859d4a975" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 39939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:03.548182 27674 mvcc.cc:205] Tried to move back new op lower bound from 7315365165239422976 to 7315365165210984448. Current Snapshot: MvccSnapshot[applied={T|T < 7315365165239422976}]
I20260806 00:57:03.548470 27677 mvcc.cc:205] Tried to move back new op lower bound from 7315365165239422976 to 7315365165210984448. Current Snapshot: MvccSnapshot[applied={T|T < 7315365165239422976}]
I20260806 00:57:03.550486 26960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:57:03.550581 26960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52316:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:57:03.551329 26960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 88195dc1e6c640458856f148d209e098: Sending DeleteTablet for 3 replicas of tablet 480b217b9682477298b51c2bcc15003b
I20260806 00:57:03.551694 27529 tablet_service.cc:1514] Processing DeleteTablet for tablet 480b217b9682477298b51c2bcc15003b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:03 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:51156
I20260806 00:57:03.551744 27332 tablet_service.cc:1514] Processing DeleteTablet for tablet 480b217b9682477298b51c2bcc15003b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:03 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:47122
I20260806 00:57:03.551967 27141 tablet_service.cc:1514] Processing DeleteTablet for tablet 480b217b9682477298b51c2bcc15003b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:03 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:37990
I20260806 00:57:03.552000 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 27043
I20260806 00:57:03.557531 27689 tablet_replica.cc:330] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734: stopping tablet replica
I20260806 00:57:03.557657 27689 raft_consensus.cc:2229] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:57:03.557801 27689 raft_consensus.cc:2258] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:57:03.564661 27692 tablet_replica.cc:330] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975: stopping tablet replica
I20260806 00:57:03.564834 27692 raft_consensus.cc:2229] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:57:03.564960 27692 raft_consensus.cc:2258] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:57:03.564957 27689 ts_tablet_manager.cc:1905] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:57:03.566118 27692 ts_tablet_manager.cc:1905] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:57:03.567082 27689 ts_tablet_manager.cc:1918] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:57:03.567174 27689 log.cc:1196] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/480b217b9682477298b51c2bcc15003b
I20260806 00:57:03.567487 27689 ts_tablet_manager.cc:1939] T 480b217b9682477298b51c2bcc15003b P c896a31d83e04078adfc8b097706c734: Deleting consensus metadata
I20260806 00:57:03.567987 26936 catalog_manager.cc:4841] TS c896a31d83e04078adfc8b097706c734 (127.3.98.131:41113): tablet 480b217b9682477298b51c2bcc15003b (table test-table [id=c5fbe8810907495dae40a917adbbe11a]) successfully deleted
I20260806 00:57:03.568096 27692 ts_tablet_manager.cc:1918] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:57:03.568184 27692 log.cc:1196] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/480b217b9682477298b51c2bcc15003b
I20260806 00:57:03.568466 27692 ts_tablet_manager.cc:1939] T 480b217b9682477298b51c2bcc15003b P f3c4c1d4cb66429b8f906fe859d4a975: Deleting consensus metadata
I20260806 00:57:03.569092 26936 catalog_manager.cc:4841] TS f3c4c1d4cb66429b8f906fe859d4a975 (127.3.98.130:39939): tablet 480b217b9682477298b51c2bcc15003b (table test-table [id=c5fbe8810907495dae40a917adbbe11a]) successfully deleted
W20260806 00:57:03.571139 26940 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:38975 (error 108)
I20260806 00:57:03.571524 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 27237
I20260806 00:57:03.586009 27647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.585830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:38975 (local address 127.0.0.1:37998)
0806 00:57:03.585899 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:03.585955 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:38975: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 00:57:03.586159 26940 catalog_manager.cc:4584] TS e9af95b533174182bab67dd3a9ab8085 (127.3.98.129:38975): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 480b217b9682477298b51c2bcc15003b: Network error: Client connection negotiation failed: client connection to 127.3.98.129:38975: connect: Connection refused (error 111)
I20260806 00:57:03.591421 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 27437
I20260806 00:57:03.607986 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 26912
2026-08-06T00:57:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2162 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T00:57:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:03Z Disabled control of system clock
I20260806 00:57:03.641557 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:40945
--webserver_interface=127.3.98.190
--webserver_port=0
--builtin_ntp_servers=127.3.98.148:40491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:40945
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 00:57:03.723500 27699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:03.723724 27699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:03.723745 27699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:03.724848 27699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:03.724885 27699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:03.724898 27699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:03.724911 27699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:03.724923 27699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:03.726200 27699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:40491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:40945
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:40945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:03.726389 27699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:03.726641 27699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:03.731449 27706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:03.731424 27705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:03.731479 27708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:03.731675 27699 server_base.cc:1034] running on GCE node
I20260806 00:57:03.731909 27699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:03.732164 27699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:03.733301 27699 hybrid_clock.cc:648] HybridClock initialized: now 1785977823733293 us; error 44 us; skew 500 ppm
I20260806 00:57:03.734519 27699 webserver.cc:460] Webserver started at http://127.3.98.190:40531/ using document root <none> and password file <none>
I20260806 00:57:03.734773 27699 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:03.734822 27699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:03.734987 27699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:03.736057 27699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "b24cc3490b6743e78567a1d6b1e062d6"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "893c64919a9f8ad3d43d2c83e89958e3"
server_key_iv: "729a7d30733e06b62bfdc5947b5ea3da"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.736431 27699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "b24cc3490b6743e78567a1d6b1e062d6"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "893c64919a9f8ad3d43d2c83e89958e3"
server_key_iv: "729a7d30733e06b62bfdc5947b5ea3da"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.737763 27699 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:57:03.738452 27718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:03.738633 27699 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:57:03.738732 27699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "b24cc3490b6743e78567a1d6b1e062d6"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "893c64919a9f8ad3d43d2c83e89958e3"
server_key_iv: "729a7d30733e06b62bfdc5947b5ea3da"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.738814 27699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:03.764775 27699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:03.765127 27699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:03.765291 27699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:03.769539 27699 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:40945
I20260806 00:57:03.769574 27795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:40945 every 8 connection(s)
I20260806 00:57:03.769942 27699 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:03.770889 27797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:03.773365 27797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6: Bootstrap starting.
I20260806 00:57:03.773974 27797 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:03.774295 27797 log.cc:824] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:03.774994 27797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6: No bootstrap required, opened a new log
I20260806 00:57:03.776153 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 27699
I20260806 00:57:03.776288 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:03.776511 3466 external_mini_cluster.cc:1428] Setting key a3164ebbb0b5a0f9fe1706a9c2b372c9
I20260806 00:57:03.776942 27797 raft_consensus.cc:348] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24cc3490b6743e78567a1d6b1e062d6" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40945 } }
I20260806 00:57:03.777132 27797 raft_consensus.cc:374] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:03.777201 27797 raft_consensus.cc:729] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b24cc3490b6743e78567a1d6b1e062d6, State: Initialized, Role: FOLLOWER
I20260806 00:57:03.777400 27797 consensus_queue.cc:260] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24cc3490b6743e78567a1d6b1e062d6" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40945 } }
I20260806 00:57:03.777493 27797 raft_consensus.cc:388] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:03.777535 27797 raft_consensus.cc:482] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:03.777583 27797 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:03.778661 27797 raft_consensus.cc:504] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24cc3490b6743e78567a1d6b1e062d6" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40945 } }
I20260806 00:57:03.778775 27797 leader_election.cc:302] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b24cc3490b6743e78567a1d6b1e062d6; no voters:
I20260806 00:57:03.778932 27797 leader_election.cc:288] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:03.779009 27806 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:03.779173 27797 sys_catalog.cc:564] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:03.779208 27806 raft_consensus.cc:686] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [term 1 LEADER]: Becoming Leader. State: Replica: b24cc3490b6743e78567a1d6b1e062d6, State: Running, Role: LEADER
I20260806 00:57:03.779407 27806 consensus_queue.cc:237] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24cc3490b6743e78567a1d6b1e062d6" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40945 } }
I20260806 00:57:03.779772 27807 sys_catalog.cc:455] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b24cc3490b6743e78567a1d6b1e062d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24cc3490b6743e78567a1d6b1e062d6" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40945 } } }
I20260806 00:57:03.779855 27807 sys_catalog.cc:458] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:03.780026 27809 sys_catalog.cc:455] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b24cc3490b6743e78567a1d6b1e062d6. Latest consensus state: current_term: 1 leader_uuid: "b24cc3490b6743e78567a1d6b1e062d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b24cc3490b6743e78567a1d6b1e062d6" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40945 } } }
I20260806 00:57:03.780099 27809 sys_catalog.cc:458] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:03.780539 27820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:03.781126 27820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:03.782727 27820 catalog_manager.cc:1347] Generated new cluster ID: 6755764e74ac48269adbcce3edd8eda1
I20260806 00:57:03.782783 27820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:03.783223 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.777091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58712 (local address 127.3.98.190:40945)
0806 00:57:03.777356 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:03.777366 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:03.777400 (+ 34us) server_negotiation.cc:407] Connection header received
0806 00:57:03.777519 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:03.777526 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:03.777601 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:03.777748 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:03.777937 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.779392 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.780690 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.781204 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.781378 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.782261 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:03.782265 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:03.782266 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:03.782544 (+ 278us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:03.782581 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:03.782592 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:03.782947 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:03.782976 (+ 29us) server_negotiation.cc:299] Negotiation successful
0806 00:57:03.783048 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":135,"threads_started":1}
I20260806 00:57:03.792526 27820 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:03.793048 27820 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:03.800400 27820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6: Generated new TSK 0
I20260806 00:57:03.800616 27820 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:03.807912 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:40945
--builtin_ntp_servers=127.3.98.148:40491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 00:57:03.892678 27834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:03.892884 27834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:03.892905 27834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:03.894052 27834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:03.894094 27834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:03.894119 27834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:57:03.895468 27834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:40491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:40945
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:03.895722 27834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:03.896021 27834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:03.901085 27840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:03.901072 27841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:03.901263 27844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:03.901345 27834 server_base.cc:1034] running on GCE node
I20260806 00:57:03.901563 27834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:03.901849 27834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:03.903036 27834 hybrid_clock.cc:648] HybridClock initialized: now 1785977823903012 us; error 50 us; skew 500 ppm
I20260806 00:57:03.904567 27834 webserver.cc:460] Webserver started at http://127.3.98.129:38365/ using document root <none> and password file <none>
I20260806 00:57:03.904846 27834 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:03.904904 27834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:03.905030 27834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:03.906371 27834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "7df173e17dad4e56848d19c731b21809"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "013d96fe97d8fe2fe47d6cd9cef41642"
server_key_iv: "93517efc2b9751e6e869939ddc97f037"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.906761 27834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "7df173e17dad4e56848d19c731b21809"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "013d96fe97d8fe2fe47d6cd9cef41642"
server_key_iv: "93517efc2b9751e6e869939ddc97f037"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.908394 27834 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260806 00:57:03.909278 27850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:03.909456 27834 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:03.909546 27834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "7df173e17dad4e56848d19c731b21809"
format_stamp: "Formatted at 2026-08-06 00:57:03 on dist-test-slave-44d2"
server_key: "013d96fe97d8fe2fe47d6cd9cef41642"
server_key_iv: "93517efc2b9751e6e869939ddc97f037"
server_key_version: "encryptionkey@0"
I20260806 00:57:03.909622 27834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:03.917512 27834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:03.917820 27834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:03.917968 27834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:03.918231 27834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:03.918562 27834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:03.918597 27834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:03.918620 27834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:03.918663 27834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:03.924530 27834 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:46773
I20260806 00:57:03.924609 28016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:46773 every 8 connection(s)
I20260806 00:57:03.924965 27834 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:57:03.930092 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.925707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:40061 (local address 127.3.98.190:40945)
0806 00:57:03.925788 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:03.925791 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:03.925996 (+ 205us) server_negotiation.cc:407] Connection header received
0806 00:57:03.926482 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:03.926483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:03.926496 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:03.926557 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:03.927211 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.927732 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.928813 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.928997 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.929052 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.929893 (+ 841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:03.929893 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:03.929894 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:03.929899 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:03.929909 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:03.929913 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:03.929952 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:03.930010 (+ 58us) server_negotiation.cc:299] Negotiation successful
0806 00:57:03.930033 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 00:57:03.930305 28020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:03.925677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:40945 (local address 127.3.98.129:40061)
0806 00:57:03.925879 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:03.925915 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:03.926401 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:03.926612 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:03.926616 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:03.926624 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:03.927142 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.927147 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.927817 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.927818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.928742 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:03.928745 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:03.929079 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:03.929080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:03.929189 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:03.929768 (+ 579us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:57:03.929768 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:03.929797 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:57:03.929823 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:03.929953 (+ 130us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:03.929955 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:03.929957 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:57:03.930003 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 00:57:03.930083 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":106,"threads_started":1}
I20260806 00:57:03.930776 28017 heartbeater.cc:347] Connected to a master server at 127.3.98.190:40945
I20260806 00:57:03.930863 28017 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:03.931010 28017 heartbeater.cc:511] Master 127.3.98.190:40945 requested a full tablet report, sending...
I20260806 00:57:03.931504 27746 ts_manager.cc:194] Registered new tserver with Master: 7df173e17dad4e56848d19c731b21809 (127.3.98.129:46773)
I20260806 00:57:03.932195 27746 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.98.129:40061
I20260806 00:57:03.933941 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 27834
I20260806 00:57:03.934062 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:57:03.934267 3466 external_mini_cluster.cc:1428] Setting key 2b17bcd4bdf2d405ce5746f3e4de3c68
I20260806 00:57:03.935151 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:40945
--builtin_ntp_servers=127.3.98.148:40491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 00:57:04.020579 28021 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:04.020782 28021 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:04.020804 28021 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:04.021904 28021 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:04.021946 28021 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:04.021970 28021 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:57:04.023239 28021 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:40491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:40945
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28021
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:04.023437 28021 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:04.023697 28021 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:04.028815 28027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:04.028949 28028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:04.028815 28032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:04.029047 28021 server_base.cc:1034] running on GCE node
I20260806 00:57:04.029276 28021 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:04.029495 28021 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:04.030633 28021 hybrid_clock.cc:648] HybridClock initialized: now 1785977824030622 us; error 28 us; skew 500 ppm
I20260806 00:57:04.031985 28021 webserver.cc:460] Webserver started at http://127.3.98.130:43101/ using document root <none> and password file <none>
I20260806 00:57:04.032251 28021 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:04.032305 28021 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:04.032517 28021 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:04.033663 28021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "8b480a00aea443b3a38aeb22a1d0ede0"
format_stamp: "Formatted at 2026-08-06 00:57:04 on dist-test-slave-44d2"
server_key: "fa249802b289b78615878c6ee81642da"
server_key_iv: "dec6a0b60d861d81c976cb90474028a4"
server_key_version: "encryptionkey@0"
I20260806 00:57:04.034030 28021 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "8b480a00aea443b3a38aeb22a1d0ede0"
format_stamp: "Formatted at 2026-08-06 00:57:04 on dist-test-slave-44d2"
server_key: "fa249802b289b78615878c6ee81642da"
server_key_iv: "dec6a0b60d861d81c976cb90474028a4"
server_key_version: "encryptionkey@0"
I20260806 00:57:04.035367 28021 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:04.036087 28044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:04.036257 28021 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:04.036360 28021 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "8b480a00aea443b3a38aeb22a1d0ede0"
format_stamp: "Formatted at 2026-08-06 00:57:04 on dist-test-slave-44d2"
server_key: "fa249802b289b78615878c6ee81642da"
server_key_iv: "dec6a0b60d861d81c976cb90474028a4"
server_key_version: "encryptionkey@0"
I20260806 00:57:04.036443 28021 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:04.049834 28021 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:04.050148 28021 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:04.050298 28021 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:04.050532 28021 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:04.050900 28021 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:04.050954 28021 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:04.050987 28021 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:04.051015 28021 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:04.057024 28021 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:43989
I20260806 00:57:04.057081 28201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:43989 every 8 connection(s)
I20260806 00:57:04.057417 28021 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:57:04.060920 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 28021
I20260806 00:57:04.061049 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:57:04.061398 3466 external_mini_cluster.cc:1428] Setting key d00eb22898a39dac3fada644c23c68f0
I20260806 00:57:04.062402 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:40945
--builtin_ntp_servers=127.3.98.148:40491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 00:57:04.063022 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.058117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:51841 (local address 127.3.98.190:40945)
0806 00:57:04.058208 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:04.058210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:04.058433 (+ 223us) server_negotiation.cc:407] Connection header received
0806 00:57:04.058916 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:04.058917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:04.058928 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:04.058984 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:04.059705 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.060202 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.061336 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.061627 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.061705 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.062688 (+ 983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:04.062689 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:04.062690 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:04.062697 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:04.062713 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:04.062719 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:04.062776 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:04.062868 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 00:57:04.062902 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 00:57:04.063156 28204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.058094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:40945 (local address 127.3.98.130:51841)
0806 00:57:04.058309 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:04.058344 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:04.058831 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:04.059052 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:04.059056 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:04.059065 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:04.059591 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.059597 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.060288 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.060289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.061223 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.061226 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.061715 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.061717 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.061853 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.062476 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:57:04.062476 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:04.062526 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:57:04.062555 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:04.062793 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:04.062799 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:04.062801 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:57:04.062854 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 00:57:04.062940 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":109,"threads_started":1}
I20260806 00:57:04.063608 28202 heartbeater.cc:347] Connected to a master server at 127.3.98.190:40945
I20260806 00:57:04.063715 28202 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:04.063926 28202 heartbeater.cc:511] Master 127.3.98.190:40945 requested a full tablet report, sending...
I20260806 00:57:04.064379 27746 ts_manager.cc:194] Registered new tserver with Master: 8b480a00aea443b3a38aeb22a1d0ede0 (127.3.98.130:43989)
I20260806 00:57:04.064960 27746 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.98.130:51841
W20260806 00:57:04.147172 28205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:04.147380 28205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:04.147403 28205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:04.148607 28205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:04.148648 28205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:04.148694 28205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:57:04.150053 28205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:40491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:40945
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:04.150300 28205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:04.150605 28205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 00:57:04.155858 28205 server_base.cc:1034] running on GCE node
W20260806 00:57:04.155830 28214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:04.155918 28212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:04.155812 28216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:04.156275 28205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:04.156534 28205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:04.157677 28205 hybrid_clock.cc:648] HybridClock initialized: now 1785977824157664 us; error 30 us; skew 500 ppm
I20260806 00:57:04.158936 28205 webserver.cc:460] Webserver started at http://127.3.98.131:44907/ using document root <none> and password file <none>
I20260806 00:57:04.159192 28205 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:04.159240 28205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:04.159407 28205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:04.160547 28205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "02eea41ecd9f4fcd9142389abeea3759"
format_stamp: "Formatted at 2026-08-06 00:57:04 on dist-test-slave-44d2"
server_key: "2406328e3b4c33f929f4307a1dcf4d51"
server_key_iv: "7ca78d0663f7101f9fd0ad7efade3426"
server_key_version: "encryptionkey@0"
I20260806 00:57:04.160917 28205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "02eea41ecd9f4fcd9142389abeea3759"
format_stamp: "Formatted at 2026-08-06 00:57:04 on dist-test-slave-44d2"
server_key: "2406328e3b4c33f929f4307a1dcf4d51"
server_key_iv: "7ca78d0663f7101f9fd0ad7efade3426"
server_key_version: "encryptionkey@0"
I20260806 00:57:04.162227 28205 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:04.162921 28224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:04.163074 28205 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:04.163167 28205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "02eea41ecd9f4fcd9142389abeea3759"
format_stamp: "Formatted at 2026-08-06 00:57:04 on dist-test-slave-44d2"
server_key: "2406328e3b4c33f929f4307a1dcf4d51"
server_key_iv: "7ca78d0663f7101f9fd0ad7efade3426"
server_key_version: "encryptionkey@0"
I20260806 00:57:04.163223 28205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:04.171793 28205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:04.172020 28205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:04.172128 28205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:04.172307 28205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:04.172652 28205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:04.172690 28205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:04.172711 28205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:04.172724 28205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:04.178373 28205 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:32923
I20260806 00:57:04.178428 28385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:32923 every 8 connection(s)
I20260806 00:57:04.178750 28205 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:57:04.183961 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.179566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:48997 (local address 127.3.98.190:40945)
0806 00:57:04.179632 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:04.179636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:04.179881 (+ 245us) server_negotiation.cc:407] Connection header received
0806 00:57:04.180538 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:04.180540 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:04.180555 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:04.180605 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:04.181276 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.181764 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.182692 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.182866 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.182915 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.183764 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:04.183765 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:04.183765 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:04.183769 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:04.183782 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:04.183785 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:04.183829 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:04.183879 (+ 50us) server_negotiation.cc:299] Negotiation successful
0806 00:57:04.183901 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 00:57:04.184206 28389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.179547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:40945 (local address 127.3.98.131:48997)
0806 00:57:04.179767 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:04.179799 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:04.180399 (+ 600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:04.180681 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:04.180685 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:04.180694 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:04.181204 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.181208 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.181851 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.181851 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.182622 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.182624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.182936 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.182937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.183060 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.183636 (+ 576us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:57:04.183636 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:04.183665 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:57:04.183688 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:04.183829 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:04.183831 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:04.183833 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:57:04.183874 (+ 41us) client_negotiation.cc:240] Negotiation successful
0806 00:57:04.183952 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":109,"threads_started":1}
I20260806 00:57:04.184790 28387 heartbeater.cc:347] Connected to a master server at 127.3.98.190:40945
I20260806 00:57:04.184893 28387 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:04.185091 28387 heartbeater.cc:511] Master 127.3.98.190:40945 requested a full tablet report, sending...
I20260806 00:57:04.185467 27746 ts_manager.cc:194] Registered new tserver with Master: 02eea41ecd9f4fcd9142389abeea3759 (127.3.98.131:32923)
I20260806 00:57:04.185834 27746 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.98.131:48997
I20260806 00:57:04.188769 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 28205
I20260806 00:57:04.188874 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:57:04.189043 3466 external_mini_cluster.cc:1428] Setting key 0e2c18a4116619d303de1a5037e5677b
I20260806 00:57:04.189847 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:57:04.193850 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.191087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58722 (local address 127.3.98.190:40945)
0806 00:57:04.191129 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:04.191132 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:04.191298 (+ 166us) server_negotiation.cc:407] Connection header received
0806 00:57:04.191335 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:04.191336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:04.191348 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:04.191394 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:04.191543 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.191980 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.192756 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.192930 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.192982 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.193632 (+ 650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:04.193633 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:04.193633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:04.193637 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:04.193647 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:04.193650 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:04.193689 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:04.193741 (+ 52us) server_negotiation.cc:299] Negotiation successful
0806 00:57:04.193760 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 00:57:04.195358 27746 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:57:04.197098 27746 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:57:04.204282 28396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.199375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:43989 (local address 127.0.0.1:34926)
0806 00:57:04.199584 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:04.199622 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:04.199691 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:04.199962 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:04.199965 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:04.199967 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:04.200033 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.200034 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.201622 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.201623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.202977 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.202979 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.203931 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.203932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.204021 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.204035 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 00:57:04.204096 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 00:57:04.204154 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":72,"thread_start_us":84,"threads_started":1}
I20260806 00:57:04.204391 28398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.199471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36886 (local address 127.3.98.129:46773)
0806 00:57:04.199951 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:04.199955 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:04.199965 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:57:04.200006 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:04.200008 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:04.200024 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:04.200126 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:04.200688 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.201382 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.203072 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.203825 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.203877 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.203972 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:04.204259 (+ 287us) server_negotiation.cc:299] Negotiation successful
0806 00:57:04.204304 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":79,"threads_started":1}
I20260806 00:57:04.204566 28402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.199725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53334 (local address 127.3.98.131:32923)
0806 00:57:04.199880 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:04.199884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:04.200325 (+ 441us) server_negotiation.cc:407] Connection header received
0806 00:57:04.200381 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:04.200383 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:04.200399 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:04.200514 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:04.200635 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.201753 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.203388 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.203911 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.204000 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.204093 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:04.204178 (+ 85us) server_negotiation.cc:299] Negotiation successful
0806 00:57:04.204216 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":86,"threads_started":1}
I20260806 00:57:04.204885 28399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.199486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34926 (local address 127.3.98.130:43989)
0806 00:57:04.199687 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:04.199692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:04.199710 (+ 18us) server_negotiation.cc:407] Connection header received
0806 00:57:04.199813 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:04.199817 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:04.199837 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:04.199956 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:04.200199 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.201527 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.203079 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.203825 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.204260 (+ 435us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.204351 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:04.204375 (+ 24us) server_negotiation.cc:299] Negotiation successful
0806 00:57:04.204728 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":90,"threads_started":1}
I20260806 00:57:04.204913 28401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.199635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:32923 (local address 127.0.0.1:53334)
0806 00:57:04.200241 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:04.200252 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:04.200310 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:04.200524 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:04.200526 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:04.200528 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:04.200570 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.200572 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.201847 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.201849 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.203295 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.203298 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.204025 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.204026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.204092 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.204098 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 00:57:04.204162 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 00:57:04.204210 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":76,"threads_started":1}
I20260806 00:57:04.205049 28397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.199404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:46773 (local address 127.0.0.1:36886)
0806 00:57:04.199776 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:04.199786 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:04.199829 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:04.200544 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:04.200545 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:04.200547 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:04.200587 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.200588 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.201479 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.201480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.202960 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.202963 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.204031 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.204032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.204088 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.204091 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:57:04.204137 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 00:57:04.204165 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"mutex_wait_us":38,"thread_start_us":110,"threads_started":1}
I20260806 00:57:04.205622 28290 tablet_service.cc:1467] Processing CreateTablet for tablet 1edca4ee630f44ba9e326faa482575bc (DEFAULT_TABLE table=test-table [id=64981ee4eece4da080114d5b1abc7d27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:04.205623 28112 tablet_service.cc:1467] Processing CreateTablet for tablet 1edca4ee630f44ba9e326faa482575bc (DEFAULT_TABLE table=test-table [id=64981ee4eece4da080114d5b1abc7d27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:04.206010 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1edca4ee630f44ba9e326faa482575bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:04.206010 28290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1edca4ee630f44ba9e326faa482575bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:04.208904 27918 tablet_service.cc:1467] Processing CreateTablet for tablet 1edca4ee630f44ba9e326faa482575bc (DEFAULT_TABLE table=test-table [id=64981ee4eece4da080114d5b1abc7d27]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:04.209261 27918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1edca4ee630f44ba9e326faa482575bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:04.209718 28406 tablet_bootstrap.cc:492] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0: Bootstrap starting.
I20260806 00:57:04.210497 28406 tablet_bootstrap.cc:654] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:04.210932 28406 log.cc:824] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:04.211334 28403 tablet_bootstrap.cc:492] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759: Bootstrap starting.
I20260806 00:57:04.212033 28403 tablet_bootstrap.cc:654] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:04.212344 28403 log.cc:824] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:04.212416 28408 tablet_bootstrap.cc:492] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809: Bootstrap starting.
I20260806 00:57:04.213034 28406 tablet_bootstrap.cc:492] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0: No bootstrap required, opened a new log
I20260806 00:57:04.213120 28406 ts_tablet_manager.cc:1397] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 00:57:04.213183 28408 tablet_bootstrap.cc:654] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:04.213551 28408 log.cc:824] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:04.214437 28408 tablet_bootstrap.cc:492] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809: No bootstrap required, opened a new log
I20260806 00:57:04.214512 28408 ts_tablet_manager.cc:1397] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 00:57:04.216228 28406 raft_consensus.cc:348] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7df173e17dad4e56848d19c731b21809" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 46773 } } peers { permanent_uuid: "8b480a00aea443b3a38aeb22a1d0ede0" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43989 } } peers { permanent_uuid: "02eea41ecd9f4fcd9142389abeea3759" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 32923 } }
I20260806 00:57:04.216423 28406 raft_consensus.cc:374] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:04.216464 28406 raft_consensus.cc:729] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b480a00aea443b3a38aeb22a1d0ede0, State: Initialized, Role: FOLLOWER
I20260806 00:57:04.216631 28406 consensus_queue.cc:260] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7df173e17dad4e56848d19c731b21809" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 46773 } } peers { permanent_uuid: "8b480a00aea443b3a38aeb22a1d0ede0" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43989 } } peers { permanent_uuid: "02eea41ecd9f4fcd9142389abeea3759" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 32923 } }
I20260806 00:57:04.216921 28406 ts_tablet_manager.cc:1428] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 00:57:04.216962 28202 heartbeater.cc:503] Master 127.3.98.190:40945 was elected leader, sending a full tablet report...
I20260806 00:57:04.217437 28403 tablet_bootstrap.cc:492] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759: No bootstrap required, opened a new log
I20260806 00:57:04.217376 28408 raft_consensus.cc:348] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7df173e17dad4e56848d19c731b21809" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 46773 } } peers { permanent_uuid: "8b480a00aea443b3a38aeb22a1d0ede0" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43989 } } peers { permanent_uuid: "02eea41ecd9f4fcd9142389abeea3759" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 32923 } }
I20260806 00:57:04.217527 28403 ts_tablet_manager.cc:1397] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260806 00:57:04.217527 28408 raft_consensus.cc:374] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:04.217566 28408 raft_consensus.cc:729] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7df173e17dad4e56848d19c731b21809, State: Initialized, Role: FOLLOWER
I20260806 00:57:04.217701 28408 consensus_queue.cc:260] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7df173e17dad4e56848d19c731b21809" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 46773 } } peers { permanent_uuid: "8b480a00aea443b3a38aeb22a1d0ede0" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43989 } } peers { permanent_uuid: "02eea41ecd9f4fcd9142389abeea3759" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 32923 } }
I20260806 00:57:04.218039 28017 heartbeater.cc:503] Master 127.3.98.190:40945 was elected leader, sending a full tablet report...
I20260806 00:57:04.217998 28408 ts_tablet_manager.cc:1428] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260806 00:57:04.219923 28403 raft_consensus.cc:348] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7df173e17dad4e56848d19c731b21809" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 46773 } } peers { permanent_uuid: "8b480a00aea443b3a38aeb22a1d0ede0" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43989 } } peers { permanent_uuid: "02eea41ecd9f4fcd9142389abeea3759" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 32923 } }
I20260806 00:57:04.220044 28403 raft_consensus.cc:374] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:04.220065 28403 raft_consensus.cc:729] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02eea41ecd9f4fcd9142389abeea3759, State: Initialized, Role: FOLLOWER
I20260806 00:57:04.220191 28403 consensus_queue.cc:260] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7df173e17dad4e56848d19c731b21809" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 46773 } } peers { permanent_uuid: "8b480a00aea443b3a38aeb22a1d0ede0" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43989 } } peers { permanent_uuid: "02eea41ecd9f4fcd9142389abeea3759" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 32923 } }
I20260806 00:57:04.220443 28403 ts_tablet_manager.cc:1428] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:57:04.220546 28387 heartbeater.cc:503] Master 127.3.98.190:40945 was elected leader, sending a full tablet report...
W20260806 00:57:04.308079 28203 tablet.cc:2369] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 00:57:04.425733 28019 tablet.cc:2369] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 00:57:04.429291 28388 tablet.cc:2369] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:57:04.483422 28416 raft_consensus.cc:482] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:57:04.483556 28416 raft_consensus.cc:504] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7df173e17dad4e56848d19c731b21809" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 46773 } } peers { permanent_uuid: "8b480a00aea443b3a38aeb22a1d0ede0" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43989 } } peers { permanent_uuid: "02eea41ecd9f4fcd9142389abeea3759" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 32923 } }
I20260806 00:57:04.484010 28416 leader_election.cc:288] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7df173e17dad4e56848d19c731b21809 (127.3.98.129:46773), 8b480a00aea443b3a38aeb22a1d0ede0 (127.3.98.130:43989)
I20260806 00:57:04.486847 28398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.484293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:45395 (local address 127.3.98.129:46773)
0806 00:57:04.484353 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:04.484355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:04.484365 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:57:04.484413 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:04.484413 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:04.484423 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:04.484521 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:04.484684 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.485187 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.486126 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.486507 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.486591 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.486600 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:04.486741 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 00:57:04.486777 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 00:57:04.486846 28389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.484207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:46773 (local address 127.3.98.131:45395)
0806 00:57:04.484269 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:04.484280 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:04.484324 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:04.484522 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:04.484523 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:04.484525 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:04.484605 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.484606 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.485276 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.485277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.486032 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.486034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.486591 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.486592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.486669 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.486672 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:57:04.486735 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 00:57:04.486777 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 00:57:04.487015 28417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.484230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:43989 (local address 127.3.98.131:47657)
0806 00:57:04.484425 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:04.484432 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:04.484540 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:04.484723 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:04.484724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:04.484726 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:04.484831 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.484833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.485456 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.485458 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.486191 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:04.486193 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.486756 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.486757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:04.486824 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.486827 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:57:04.486893 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 00:57:04.486932 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":105,"threads_started":1}
I20260806 00:57:04.487005 28399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.484324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:47657 (local address 127.3.98.130:43989)
0806 00:57:04.484369 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:04.484370 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:04.484536 (+ 166us) server_negotiation.cc:407] Connection header received
0806 00:57:04.484629 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:04.484630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:04.484640 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:04.484718 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:04.484908 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.485371 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.486290 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.486656 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.486739 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.486748 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:04.486900 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 00:57:04.486941 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 00:57:04.487236 27949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1edca4ee630f44ba9e326faa482575bc" candidate_uuid: "02eea41ecd9f4fcd9142389abeea3759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7df173e17dad4e56848d19c731b21809" is_pre_election: true
I20260806 00:57:04.487298 28140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1edca4ee630f44ba9e326faa482575bc" candidate_uuid: "02eea41ecd9f4fcd9142389abeea3759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b480a00aea443b3a38aeb22a1d0ede0" is_pre_election: true
I20260806 00:57:04.487407 27949 raft_consensus.cc:2454] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02eea41ecd9f4fcd9142389abeea3759 in term 0.
I20260806 00:57:04.487406 28140 raft_consensus.cc:2454] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02eea41ecd9f4fcd9142389abeea3759 in term 0.
I20260806 00:57:04.487668 28229 leader_election.cc:302] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02eea41ecd9f4fcd9142389abeea3759, 8b480a00aea443b3a38aeb22a1d0ede0; no voters:
I20260806 00:57:04.487807 28416 raft_consensus.cc:2781] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:57:04.487861 28416 raft_consensus.cc:482] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:57:04.487892 28416 raft_consensus.cc:3037] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:04.488606 28416 raft_consensus.cc:504] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7df173e17dad4e56848d19c731b21809" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 46773 } } peers { permanent_uuid: "8b480a00aea443b3a38aeb22a1d0ede0" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43989 } } peers { permanent_uuid: "02eea41ecd9f4fcd9142389abeea3759" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 32923 } }
I20260806 00:57:04.488752 28416 leader_election.cc:288] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [CANDIDATE]: Term 1 election: Requested vote from peers 7df173e17dad4e56848d19c731b21809 (127.3.98.129:46773), 8b480a00aea443b3a38aeb22a1d0ede0 (127.3.98.130:43989)
I20260806 00:57:04.488857 27949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1edca4ee630f44ba9e326faa482575bc" candidate_uuid: "02eea41ecd9f4fcd9142389abeea3759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7df173e17dad4e56848d19c731b21809"
I20260806 00:57:04.488889 28140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1edca4ee630f44ba9e326faa482575bc" candidate_uuid: "02eea41ecd9f4fcd9142389abeea3759" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b480a00aea443b3a38aeb22a1d0ede0"
I20260806 00:57:04.488940 27949 raft_consensus.cc:3037] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:04.488962 28140 raft_consensus.cc:3037] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:04.489630 27949 raft_consensus.cc:2454] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02eea41ecd9f4fcd9142389abeea3759 in term 1.
I20260806 00:57:04.489692 28140 raft_consensus.cc:2454] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02eea41ecd9f4fcd9142389abeea3759 in term 1.
I20260806 00:57:04.489840 28228 leader_election.cc:302] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02eea41ecd9f4fcd9142389abeea3759, 7df173e17dad4e56848d19c731b21809; no voters:
I20260806 00:57:04.489944 28416 raft_consensus.cc:2781] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:04.490119 28416 raft_consensus.cc:686] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [term 1 LEADER]: Becoming Leader. State: Replica: 02eea41ecd9f4fcd9142389abeea3759, State: Running, Role: LEADER
I20260806 00:57:04.490329 28416 consensus_queue.cc:237] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7df173e17dad4e56848d19c731b21809" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 46773 } } peers { permanent_uuid: "8b480a00aea443b3a38aeb22a1d0ede0" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43989 } } peers { permanent_uuid: "02eea41ecd9f4fcd9142389abeea3759" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 32923 } }
I20260806 00:57:04.491197 27746 catalog_manager.cc:5495] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02eea41ecd9f4fcd9142389abeea3759 (127.3.98.131). New cstate: current_term: 1 leader_uuid: "02eea41ecd9f4fcd9142389abeea3759" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7df173e17dad4e56848d19c731b21809" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 46773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8b480a00aea443b3a38aeb22a1d0ede0" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02eea41ecd9f4fcd9142389abeea3759" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 32923 } health_report { overall_health: HEALTHY } } }
I20260806 00:57:04.555461 28402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.553051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53338 (local address 127.3.98.131:32923)
0806 00:57:04.553117 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:04.553119 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:04.553128 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:57:04.553171 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:04.553172 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:04.553197 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:04.553277 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:04.553407 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.553886 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.554650 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:04.554870 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:04.554945 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:04.555109 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:04.555220 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:04.555307 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:04.555329 (+ 22us) server_negotiation.cc:299] Negotiation successful
0806 00:57:04.555351 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 00:57:04.557349 27949 raft_consensus.cc:1261] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809 [term 1 FOLLOWER]: Refusing update from remote peer 02eea41ecd9f4fcd9142389abeea3759: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:04.557349 28140 raft_consensus.cc:1261] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0 [term 1 FOLLOWER]: Refusing update from remote peer 02eea41ecd9f4fcd9142389abeea3759: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:04.557752 28419 consensus_queue.cc:1035] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7df173e17dad4e56848d19c731b21809" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 46773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:04.557890 28416 consensus_queue.cc:1035] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b480a00aea443b3a38aeb22a1d0ede0" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 43989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:04.560763 28425 mvcc.cc:205] Tried to move back new op lower bound from 7315365169384300544 to 7315365169113104384. Current Snapshot: MvccSnapshot[applied={T|T < 7315365169384300544}]
I20260806 00:57:04.560247 28422 mvcc.cc:205] Tried to move back new op lower bound from 7315365169384300544 to 7315365169113104384. Current Snapshot: MvccSnapshot[applied={T|T < 7315365169384300544}]
I20260806 00:57:04.560885 28424 mvcc.cc:205] Tried to move back new op lower bound from 7315365169384300544 to 7315365169113104384. Current Snapshot: MvccSnapshot[applied={T|T < 7315365169384300544 or (T in {7315365169384300544})}]
I20260806 00:57:04.563054 27746 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:57:04.563151 27746 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:57:04.563974 27746 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b24cc3490b6743e78567a1d6b1e062d6: Sending DeleteTablet for 3 replicas of tablet 1edca4ee630f44ba9e326faa482575bc
I20260806 00:57:04.564302 28112 tablet_service.cc:1514] Processing DeleteTablet for tablet 1edca4ee630f44ba9e326faa482575bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:04 UTC) from {username='slave'} at 127.0.0.1:34926
I20260806 00:57:04.564385 27918 tablet_service.cc:1514] Processing DeleteTablet for tablet 1edca4ee630f44ba9e326faa482575bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:04 UTC) from {username='slave'} at 127.0.0.1:36886
I20260806 00:57:04.564602 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 27834
I20260806 00:57:04.564620 28290 tablet_service.cc:1514] Processing DeleteTablet for tablet 1edca4ee630f44ba9e326faa482575bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:04 UTC) from {username='slave'} at 127.0.0.1:53334
I20260806 00:57:04.564648 28443 tablet_replica.cc:330] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809: stopping tablet replica
I20260806 00:57:04.564795 28443 raft_consensus.cc:2229] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:57:04.564908 28443 raft_consensus.cc:2258] T 1edca4ee630f44ba9e326faa482575bc P 7df173e17dad4e56848d19c731b21809 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:57:04.571514 28445 tablet_replica.cc:330] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759: stopping tablet replica
I20260806 00:57:04.571642 28445 raft_consensus.cc:2229] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:57:04.571777 28445 raft_consensus.cc:2258] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:57:04.573374 28445 ts_tablet_manager.cc:1905] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:57:04.575294 28445 ts_tablet_manager.cc:1918] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:57:04.575404 28445 log.cc:1196] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/1edca4ee630f44ba9e326faa482575bc
I20260806 00:57:04.575752 28445 ts_tablet_manager.cc:1939] T 1edca4ee630f44ba9e326faa482575bc P 02eea41ecd9f4fcd9142389abeea3759: Deleting consensus metadata
I20260806 00:57:04.575768 28439 tablet_replica.cc:330] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0: stopping tablet replica
I20260806 00:57:04.575907 28439 raft_consensus.cc:2229] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:57:04.576037 28439 raft_consensus.cc:2258] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:57:04.576231 27725 catalog_manager.cc:4841] TS 02eea41ecd9f4fcd9142389abeea3759 (127.3.98.131:32923): tablet 1edca4ee630f44ba9e326faa482575bc (table test-table [id=64981ee4eece4da080114d5b1abc7d27]) successfully deleted
I20260806 00:57:04.576591 28439 ts_tablet_manager.cc:1905] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:57:04.578289 28439 ts_tablet_manager.cc:1918] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:57:04.578372 28439 log.cc:1196] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/1edca4ee630f44ba9e326faa482575bc
I20260806 00:57:04.578639 28439 ts_tablet_manager.cc:1939] T 1edca4ee630f44ba9e326faa482575bc P 8b480a00aea443b3a38aeb22a1d0ede0: Deleting consensus metadata
I20260806 00:57:04.579110 27727 catalog_manager.cc:4841] TS 8b480a00aea443b3a38aeb22a1d0ede0 (127.3.98.130:43989): tablet 1edca4ee630f44ba9e326faa482575bc (table test-table [id=64981ee4eece4da080114d5b1abc7d27]) successfully deleted
W20260806 00:57:04.579802 27725 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:46773 (error 108)
I20260806 00:57:04.580047 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 28021
I20260806 00:57:04.581902 28397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:04.580235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:46773 (local address 127.0.0.1:36888)
0806 00:57:04.581802 (+ 1567us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:04.581856 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:46773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1539}
W20260806 00:57:04.582281 27725 catalog_manager.cc:4584] TS 7df173e17dad4e56848d19c731b21809 (127.3.98.129:46773): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1edca4ee630f44ba9e326faa482575bc: Network error: Client connection negotiation failed: client connection to 127.3.98.129:46773: connect: Connection refused (error 111)
I20260806 00:57:04.586848 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 28205
I20260806 00:57:04.594884 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 27699
2026-08-06T00:57:04Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (986 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:04 dist-test-slave-44d2 krb5kdc[28451](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:04 dist-test-slave-44d2 krb5kdc[28451](info): set up 2 sockets
Aug 06 00:57:04 dist-test-slave-44d2 krb5kdc[28451](info): commencing operation
krb5kdc: starting...
W20260806 00:57:05.822183 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:05 dist-test-slave-44d2 krb5kdc[28451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:57:05.945744 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:43685
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:44527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:43685
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:06.029497 28472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:06.029701 28472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:06.029724 28472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:06.030798 28472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:06.030833 28472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:06.030848 28472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:06.030860 28472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:06.030872 28472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:06.032387 28472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:43685
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:43685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:06.032685 28472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:06.032948 28472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:06.037774 28478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:06.037803 28481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:06.037814 28477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:06.038054 28472 server_base.cc:1034] running on GCE node
I20260806 00:57:06.038277 28472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:06.038594 28472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:06.039738 28472 hybrid_clock.cc:648] HybridClock initialized: now 1785977826039722 us; error 28 us; skew 500 ppm
Aug 06 00:57:06 dist-test-slave-44d2 krb5kdc[28451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977826, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:06.042361 28472 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:57:06.042879 28472 webserver.cc:460] Webserver started at http://127.3.98.190:34817/ using document root <none> and password file <none>
I20260806 00:57:06.043133 28472 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:06.043181 28472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:06.043349 28472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:06.044414 28472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "3924137316eb445ca440b867c5f05d95"
format_stamp: "Formatted at 2026-08-06 00:57:06 on dist-test-slave-44d2"
server_key: "d1da1816f15f708ac6e010f1e5015cd0"
server_key_iv: "a72de83b823a82e5a3a1eac16ef44c0c"
server_key_version: "encryptionkey@0"
I20260806 00:57:06.044855 28472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "3924137316eb445ca440b867c5f05d95"
format_stamp: "Formatted at 2026-08-06 00:57:06 on dist-test-slave-44d2"
server_key: "d1da1816f15f708ac6e010f1e5015cd0"
server_key_iv: "a72de83b823a82e5a3a1eac16ef44c0c"
server_key_version: "encryptionkey@0"
I20260806 00:57:06.046219 28472 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:06.046949 28492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:06.047123 28472 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:06.047233 28472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "3924137316eb445ca440b867c5f05d95"
format_stamp: "Formatted at 2026-08-06 00:57:06 on dist-test-slave-44d2"
server_key: "d1da1816f15f708ac6e010f1e5015cd0"
server_key_iv: "a72de83b823a82e5a3a1eac16ef44c0c"
server_key_version: "encryptionkey@0"
I20260806 00:57:06.047310 28472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:06.057593 28472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:06.059396 28472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:06.059561 28472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:06.063974 28472 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:43685
I20260806 00:57:06.064031 28566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:43685 every 8 connection(s)
I20260806 00:57:06.064391 28472 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:06.065321 28567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:06.067597 28567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95: Bootstrap starting.
I20260806 00:57:06.068158 28567 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:06.068410 28567 log.cc:824] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:06.069177 28567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95: No bootstrap required, opened a new log
I20260806 00:57:06.070742 28567 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3924137316eb445ca440b867c5f05d95" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 43685 } }
I20260806 00:57:06.070883 28567 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:06.070904 28567 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3924137316eb445ca440b867c5f05d95, State: Initialized, Role: FOLLOWER
I20260806 00:57:06.071053 28567 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3924137316eb445ca440b867c5f05d95" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 43685 } }
I20260806 00:57:06.071138 28567 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:06.071162 28567 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:06.071192 28567 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:06.071591 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 28472
I20260806 00:57:06.071715 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:06.071949 3466 external_mini_cluster.cc:1428] Setting key fbf0323cdb755aa0ecca3adbcf2b76fa
I20260806 00:57:06.071928 28567 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3924137316eb445ca440b867c5f05d95" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 43685 } }
I20260806 00:57:06.072034 28567 leader_election.cc:302] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3924137316eb445ca440b867c5f05d95; no voters:
I20260806 00:57:06.072204 28567 leader_election.cc:288] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:06.072268 28572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:06.072517 28572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [term 1 LEADER]: Becoming Leader. State: Replica: 3924137316eb445ca440b867c5f05d95, State: Running, Role: LEADER
I20260806 00:57:06.072552 28567 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:06.072727 28572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3924137316eb445ca440b867c5f05d95" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 43685 } }
I20260806 00:57:06.073269 28576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3924137316eb445ca440b867c5f05d95. Latest consensus state: current_term: 1 leader_uuid: "3924137316eb445ca440b867c5f05d95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3924137316eb445ca440b867c5f05d95" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 43685 } } }
I20260806 00:57:06.073453 28576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:06.073752 28575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3924137316eb445ca440b867c5f05d95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3924137316eb445ca440b867c5f05d95" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 43685 } } }
I20260806 00:57:06.073807 28589 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:06.073925 28575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:06.074499 28589 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:06.076160 28589 catalog_manager.cc:1347] Generated new cluster ID: 3f9f35ef8abb4ab3ba2133c33f080d21
I20260806 00:57:06.076215 28589 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:57:06 dist-test-slave-44d2 krb5kdc[28451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:06.084833 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.072511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41158 (local address 127.3.98.190:43685)
0806 00:57:06.073130 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:06.073141 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:06.073174 (+ 33us) server_negotiation.cc:407] Connection header received
0806 00:57:06.073296 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:06.073303 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:06.073363 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:06.074254 (+ 891us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:06.074666 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.075912 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.077054 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.077674 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.077811 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.080728 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:06.080733 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:06.080733 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:06.080746 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:06.082845 (+ 2099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:06.083257 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:06.083261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:06.083261 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:06.083387 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:06.083601 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:06.083603 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:06.083603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:06.083934 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:06.084121 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:06.084406 (+ 285us) server_negotiation.cc:299] Negotiation successful
0806 00:57:06.084592 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":83,"threads_started":1}
I20260806 00:57:06.107545 28589 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:06.108176 28589 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:06.115134 28589 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95: Generated new TSK 0
I20260806 00:57:06.115341 28589 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:57:06.155445 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:43685
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:44527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:06.240808 28606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:06.241019 28606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:06.241041 28606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:06.242271 28606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:06.242319 28606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:06.242376 28606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:57:06.243847 28606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:43685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:06.244107 28606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:06.244334 28606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:06.249333 28613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:06.249339 28614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:06.249307 28618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:06.249711 28606 server_base.cc:1034] running on GCE node
I20260806 00:57:06.249945 28606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:06.250195 28606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:06.251370 28606 hybrid_clock.cc:648] HybridClock initialized: now 1785977826251356 us; error 28 us; skew 500 ppm
Aug 06 00:57:06 dist-test-slave-44d2 krb5kdc[28451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977826, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:06.254052 28606 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:57:06.254488 28606 webserver.cc:460] Webserver started at http://127.3.98.129:40417/ using document root <none> and password file <none>
I20260806 00:57:06.254745 28606 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:06.254817 28606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:06.254974 28606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:06.256027 28606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "0246ae1733344ede8922ebc94459b192"
format_stamp: "Formatted at 2026-08-06 00:57:06 on dist-test-slave-44d2"
server_key: "5b23aa9f31b20b3959205a388cd1629f"
server_key_iv: "919f8aeb6e2edfca5d446cd2b1983af0"
server_key_version: "encryptionkey@0"
I20260806 00:57:06.256408 28606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "0246ae1733344ede8922ebc94459b192"
format_stamp: "Formatted at 2026-08-06 00:57:06 on dist-test-slave-44d2"
server_key: "5b23aa9f31b20b3959205a388cd1629f"
server_key_iv: "919f8aeb6e2edfca5d446cd2b1983af0"
server_key_version: "encryptionkey@0"
I20260806 00:57:06.257831 28606 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:57:06.258643 28626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:06.258824 28606 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:06.259006 28606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "0246ae1733344ede8922ebc94459b192"
format_stamp: "Formatted at 2026-08-06 00:57:06 on dist-test-slave-44d2"
server_key: "5b23aa9f31b20b3959205a388cd1629f"
server_key_iv: "919f8aeb6e2edfca5d446cd2b1983af0"
server_key_version: "encryptionkey@0"
I20260806 00:57:06.259092 28606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:06.277462 28606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:06.279496 28606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:06.279670 28606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:06.279909 28606 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:06.280249 28606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:06.280313 28606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:06.280359 28606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:06.280382 28606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:06.286360 28606 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:36493
I20260806 00:57:06.286456 28790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:36493 every 8 connection(s)
I20260806 00:57:06.286780 28606 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:57:06.291462 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 28606
I20260806 00:57:06.291599 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:57:06.291821 3466 external_mini_cluster.cc:1428] Setting key 710980b51b982113730a7012a6fb48b5
Aug 06 00:57:06 dist-test-slave-44d2 krb5kdc[28451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977826, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:06.297415 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.287552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:50973 (local address 127.3.98.190:43685)
0806 00:57:06.287633 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:06.287636 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:06.287841 (+ 205us) server_negotiation.cc:407] Connection header received
0806 00:57:06.288365 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:06.288366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:06.288379 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:06.288453 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:06.289470 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.290004 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.290991 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.291203 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.291285 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.294167 (+ 2882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:06.294169 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:06.294169 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:06.294181 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:06.295750 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:06.296326 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:06.296327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:06.296327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:06.296386 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:06.296726 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:06.296727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:06.296727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:06.296848 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:06.296908 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:06.297269 (+ 361us) server_negotiation.cc:299] Negotiation successful
0806 00:57:06.297348 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 00:57:06.297776 28795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.287538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:43685 (local address 127.3.98.129:50973)
0806 00:57:06.287713 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:06.287750 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:06.288236 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:06.288559 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:06.288566 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:06.289161 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:06.289362 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.289367 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.290113 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.290114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.290900 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.290902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.291318 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.291319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.291475 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.292165 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:06.292174 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:06.294044 (+ 1870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:06.295891 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:06.295900 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:06.295902 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:06.296243 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:06.296463 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:06.296464 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:06.296465 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:06.296652 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:06.296921 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:06.296929 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:06.297108 (+ 179us) client_negotiation.cc:769] Sending connection context
0806 00:57:06.297224 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 00:57:06.297437 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":107,"threads_started":1}
I20260806 00:57:06.298393 28791 heartbeater.cc:347] Connected to a master server at 127.3.98.190:43685
I20260806 00:57:06.298529 28791 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:06.298745 28791 heartbeater.cc:511] Master 127.3.98.190:43685 requested a full tablet report, sending...
I20260806 00:57:06.299333 28521 ts_manager.cc:194] Registered new tserver with Master: 0246ae1733344ede8922ebc94459b192 (127.3.98.129:36493)
I20260806 00:57:06.299994 28521 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:50973
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:57:06.321372 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:43685
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:44527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:06.405887 28799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:06.406098 28799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:06.406158 28799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:06.407312 28799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:06.407356 28799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:06.407406 28799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:57:06.408896 28799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:43685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:06.409150 28799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:06.409403 28799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:06.414415 28811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:06.414445 28807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:06.414414 28808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:06.414649 28799 server_base.cc:1034] running on GCE node
I20260806 00:57:06.414848 28799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:06.415064 28799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:06.416230 28799 hybrid_clock.cc:648] HybridClock initialized: now 1785977826416216 us; error 27 us; skew 500 ppm
Aug 06 00:57:06 dist-test-slave-44d2 krb5kdc[28451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977826, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:06.418759 28799 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:57:06.419265 28799 webserver.cc:460] Webserver started at http://127.3.98.130:43007/ using document root <none> and password file <none>
I20260806 00:57:06.419538 28799 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:06.419606 28799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:06.419761 28799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:06.420851 28799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb"
format_stamp: "Formatted at 2026-08-06 00:57:06 on dist-test-slave-44d2"
server_key: "598114a3a7aeca49e70112d8c5220cef"
server_key_iv: "3516dedb6973e3a4e10b673b47f0612f"
server_key_version: "encryptionkey@0"
I20260806 00:57:06.421252 28799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb"
format_stamp: "Formatted at 2026-08-06 00:57:06 on dist-test-slave-44d2"
server_key: "598114a3a7aeca49e70112d8c5220cef"
server_key_iv: "3516dedb6973e3a4e10b673b47f0612f"
server_key_version: "encryptionkey@0"
I20260806 00:57:06.422565 28799 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:57:06.423318 28819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:06.423501 28799 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:06.423604 28799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb"
format_stamp: "Formatted at 2026-08-06 00:57:06 on dist-test-slave-44d2"
server_key: "598114a3a7aeca49e70112d8c5220cef"
server_key_iv: "3516dedb6973e3a4e10b673b47f0612f"
server_key_version: "encryptionkey@0"
I20260806 00:57:06.423686 28799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:06.443886 28799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:06.445873 28799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:06.446046 28799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:06.446306 28799 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:06.446641 28799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:06.446699 28799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:06.446740 28799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:06.446772 28799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:06.453092 28799 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:42863
I20260806 00:57:06.453136 28975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:42863 every 8 connection(s)
I20260806 00:57:06.453473 28799 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:57:06.456979 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 28799
I20260806 00:57:06.457109 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:57:06.457324 3466 external_mini_cluster.cc:1428] Setting key 73ab3e898d84e063cd2b38f2ef0826c5
Aug 06 00:57:06 dist-test-slave-44d2 krb5kdc[28451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977826, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:06.464260 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.454226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:56319 (local address 127.3.98.190:43685)
0806 00:57:06.454298 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:06.454301 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:06.454508 (+ 207us) server_negotiation.cc:407] Connection header received
0806 00:57:06.454985 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:06.454986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:06.454997 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:06.455058 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:06.456005 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.456550 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.457968 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.458223 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.458280 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.460956 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:06.460958 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:06.460959 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:06.460968 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:06.462652 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:06.463172 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:06.463173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:06.463174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:06.463244 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:06.463541 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:06.463542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:06.463542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:06.463699 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:06.463780 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:06.464037 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 00:57:06.464138 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 00:57:06.464293 28979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.454209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:43685 (local address 127.3.98.130:56319)
0806 00:57:06.454381 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:06.454417 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:06.454897 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:06.455130 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:06.455133 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:06.455731 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:06.455921 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.455926 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.456644 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.456645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.457858 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.457861 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.458313 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.458314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.458470 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.458985 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:06.458996 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:06.460855 (+ 1859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:06.462744 (+ 1889us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:06.462753 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:06.462756 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:06.463093 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:06.463330 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:06.463331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:06.463331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:06.463459 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:06.463774 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:06.463779 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:06.463897 (+ 118us) client_negotiation.cc:769] Sending connection context
0806 00:57:06.463984 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 00:57:06.464125 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":95,"threads_started":1}
I20260806 00:57:06.465006 28976 heartbeater.cc:347] Connected to a master server at 127.3.98.190:43685
I20260806 00:57:06.465229 28976 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:06.465444 28976 heartbeater.cc:511] Master 127.3.98.190:43685 requested a full tablet report, sending...
I20260806 00:57:06.465909 28521 ts_manager.cc:194] Registered new tserver with Master: aff0ff77c8bd4b098c01c3d5f0fcd8cb (127.3.98.130:42863)
I20260806 00:57:06.466434 28521 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:56319
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:57:06.486996 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:43685
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:44527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:06.573931 28982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:06.574263 28982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:06.574308 28982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:06.575460 28982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:06.575544 28982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:06.575593 28982 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:57:06.577153 28982 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:43685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:06.577351 28982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:06.577545 28982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:06.582923 28993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:06.582892 28994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:06.583055 28982 server_base.cc:1034] running on GCE node
W20260806 00:57:06.582912 28996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:06.583382 28982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:06.583612 28982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:06.584756 28982 hybrid_clock.cc:648] HybridClock initialized: now 1785977826584744 us; error 31 us; skew 500 ppm
Aug 06 00:57:06 dist-test-slave-44d2 krb5kdc[28451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977826, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:06.592653 28982 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:57:06.593115 28982 webserver.cc:460] Webserver started at http://127.3.98.131:43199/ using document root <none> and password file <none>
I20260806 00:57:06.593349 28982 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:06.593396 28982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:06.593554 28982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:06.594628 28982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "8d34918edc7547cb9d19a584c35c0b93"
format_stamp: "Formatted at 2026-08-06 00:57:06 on dist-test-slave-44d2"
server_key: "a9920d3f8c3533dae6d9d3015f88179c"
server_key_iv: "3fe8d7453584182a4a7653ec0d12828c"
server_key_version: "encryptionkey@0"
I20260806 00:57:06.594996 28982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "8d34918edc7547cb9d19a584c35c0b93"
format_stamp: "Formatted at 2026-08-06 00:57:06 on dist-test-slave-44d2"
server_key: "a9920d3f8c3533dae6d9d3015f88179c"
server_key_iv: "3fe8d7453584182a4a7653ec0d12828c"
server_key_version: "encryptionkey@0"
I20260806 00:57:06.596405 28982 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:06.597193 29005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:06.597380 28982 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:06.597456 28982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "8d34918edc7547cb9d19a584c35c0b93"
format_stamp: "Formatted at 2026-08-06 00:57:06 on dist-test-slave-44d2"
server_key: "a9920d3f8c3533dae6d9d3015f88179c"
server_key_iv: "3fe8d7453584182a4a7653ec0d12828c"
server_key_version: "encryptionkey@0"
I20260806 00:57:06.597533 28982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:06.615808 28982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:06.617750 28982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:06.617866 28982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:06.618067 28982 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:06.618336 28982 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:06.618366 28982 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:06.618388 28982 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:06.618402 28982 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:06.624426 28982 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:42231
I20260806 00:57:06.624526 29168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:42231 every 8 connection(s)
I20260806 00:57:06.624882 28982 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
Aug 06 00:57:06 dist-test-slave-44d2 krb5kdc[28451](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977826, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:06.632805 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 28982
I20260806 00:57:06.632931 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:57:06.633144 3466 external_mini_cluster.cc:1428] Setting key 83b82715a61f19f0ccf3f92b75a23db6
I20260806 00:57:06.634423 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.625656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:58743 (local address 127.3.98.190:43685)
0806 00:57:06.625701 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:06.625703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:06.625914 (+ 211us) server_negotiation.cc:407] Connection header received
0806 00:57:06.626464 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:06.626465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:06.626475 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:06.626555 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:06.627574 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.628085 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.629143 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.629330 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.629385 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.631570 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:06.631571 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:06.631571 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:06.631578 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:06.632844 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:06.633342 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:06.633343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:06.633344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:06.633420 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:06.633732 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:06.633733 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:06.633734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:06.633882 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:06.633962 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:06.634288 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 00:57:06.634359 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 00:57:06.634634 29171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.625607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:43685 (local address 127.3.98.131:58743)
0806 00:57:06.625776 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:06.625819 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:06.626372 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:06.626633 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:06.626636 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:06.627235 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:06.627492 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.627497 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.628169 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.628170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.629065 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.629068 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.629405 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.629406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.629510 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.630078 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:06.630087 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:06.631475 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:06.632966 (+ 1491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:06.632973 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:06.632975 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:06.633261 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:06.633505 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:06.633506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:06.633507 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:06.633658 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:06.633973 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:06.633980 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:06.634144 (+ 164us) client_negotiation.cc:769] Sending connection context
0806 00:57:06.634260 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 00:57:06.634387 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
I20260806 00:57:06.635087 29169 heartbeater.cc:347] Connected to a master server at 127.3.98.190:43685
I20260806 00:57:06.635200 29169 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:06.635386 29169 heartbeater.cc:511] Master 127.3.98.190:43685 requested a full tablet report, sending...
I20260806 00:57:06.635766 28521 ts_manager.cc:194] Registered new tserver with Master: 8d34918edc7547cb9d19a584c35c0b93 (127.3.98.131:42231)
I20260806 00:57:06.636164 28521 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:58743
I20260806 00:57:06.645071 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:57:06.655265 28578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.646717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41174 (local address 127.3.98.190:43685)
0806 00:57:06.646766 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:06.646768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:06.646956 (+ 188us) server_negotiation.cc:407] Connection header received
0806 00:57:06.647001 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:06.647002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:06.647013 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:06.647097 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:06.647877 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.648730 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.649911 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.650162 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.650240 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.652051 (+ 1811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:06.652052 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:06.652052 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:06.652061 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:06.653844 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:06.654277 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:06.654278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:06.654278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:06.654345 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:06.654581 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:06.654582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:06.654582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:06.654771 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:06.654881 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:06.655089 (+ 208us) server_negotiation.cc:299] Negotiation successful
0806 00:57:06.655156 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 00:57:06.657079 28521 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41174:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:57:06.658599 28521 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:57:06.665553 29185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.661118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46620 (local address 127.3.98.130:42863)
0806 00:57:06.661944 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:06.661949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:06.661958 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:57:06.661995 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:06.661998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:06.662014 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:06.662113 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:06.662197 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.663043 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.664647 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.665147 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.665242 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.665304 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:06.665437 (+ 133us) server_negotiation.cc:299] Negotiation successful
0806 00:57:06.665478 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":94,"threads_started":1}
I20260806 00:57:06.665585 29181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.661007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:42863 (local address 127.0.0.1:46620)
0806 00:57:06.661266 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:06.661307 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:06.661405 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:06.662109 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:06.662110 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:06.662112 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:06.662144 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.662145 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.663162 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.663163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.664520 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.664523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.665243 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.665244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.665325 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.665338 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 00:57:06.665412 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 00:57:06.665469 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":87,"thread_start_us":111,"threads_started":1}
I20260806 00:57:06.665875 29184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.661009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:42231 (local address 127.0.0.1:53022)
0806 00:57:06.661266 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:06.661308 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:06.661394 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:06.661961 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:06.661963 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:06.661965 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:06.662019 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.662020 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.663312 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.663313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.664597 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.664599 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.665519 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.665520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.665575 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.665578 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:57:06.665773 (+ 195us) client_negotiation.cc:240] Negotiation successful
0806 00:57:06.665813 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":16,"thread_start_us":46,"threads_started":1}
I20260806 00:57:06.666208 29187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.661454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53022 (local address 127.3.98.131:42231)
0806 00:57:06.661714 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:06.661719 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:06.661730 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:57:06.661771 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:06.661774 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:06.661791 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:06.661869 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:06.662107 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.663217 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.664677 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.665370 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.665434 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.665487 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:06.666070 (+ 583us) server_negotiation.cc:299] Negotiation successful
0806 00:57:06.666119 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":110,"threads_started":1}
I20260806 00:57:06.666359 29186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.661262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36674 (local address 127.3.98.129:36493)
0806 00:57:06.661438 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:06.661443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:06.661575 (+ 132us) server_negotiation.cc:407] Connection header received
0806 00:57:06.661665 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:06.661668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:06.661685 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:06.661772 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:06.661959 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.663117 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.664400 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.665171 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.665246 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.665304 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:06.665636 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 00:57:06.665858 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":90,"threads_started":1}
I20260806 00:57:06.666502 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.661014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:36493 (local address 127.0.0.1:36674)
0806 00:57:06.661500 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:06.661508 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:06.661558 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:06.661793 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:06.661796 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:06.661798 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:06.661869 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.661871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.663235 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.663236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.664311 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.664314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.665344 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.665345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.665415 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.665420 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:57:06.665468 (+ 48us) client_negotiation.cc:240] Negotiation successful
0806 00:57:06.665530 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":51,"thread_start_us":119,"threads_started":1}
I20260806 00:57:06.666378 28880 tablet_service.cc:1467] Processing CreateTablet for tablet af459bd2c4c643e08c6abbd6da58b074 (DEFAULT_TABLE table=test-table [id=d00d680f3cf745999704de66b640e091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:06.666760 28880 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af459bd2c4c643e08c6abbd6da58b074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:06.666885 29072 tablet_service.cc:1467] Processing CreateTablet for tablet af459bd2c4c643e08c6abbd6da58b074 (DEFAULT_TABLE table=test-table [id=d00d680f3cf745999704de66b640e091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:06.667201 29072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af459bd2c4c643e08c6abbd6da58b074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:06.667141 28692 tablet_service.cc:1467] Processing CreateTablet for tablet af459bd2c4c643e08c6abbd6da58b074 (DEFAULT_TABLE table=test-table [id=d00d680f3cf745999704de66b640e091]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:06.667399 28692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af459bd2c4c643e08c6abbd6da58b074. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:06.670303 29190 tablet_bootstrap.cc:492] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb: Bootstrap starting.
I20260806 00:57:06.670826 29192 tablet_bootstrap.cc:492] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93: Bootstrap starting.
I20260806 00:57:06.670951 29190 tablet_bootstrap.cc:654] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:06.670992 29189 tablet_bootstrap.cc:492] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192: Bootstrap starting.
I20260806 00:57:06.671427 29190 log.cc:824] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:06.671541 29192 tablet_bootstrap.cc:654] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:06.671773 29189 tablet_bootstrap.cc:654] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:06.672168 29190 tablet_bootstrap.cc:492] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb: No bootstrap required, opened a new log
I20260806 00:57:06.672194 29192 log.cc:824] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:06.672255 29190 ts_tablet_manager.cc:1397] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:57:06.672361 29189 log.cc:824] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:06.673095 29192 tablet_bootstrap.cc:492] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93: No bootstrap required, opened a new log
I20260806 00:57:06.673169 29192 ts_tablet_manager.cc:1397] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:57:06.673208 29189 tablet_bootstrap.cc:492] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192: No bootstrap required, opened a new log
I20260806 00:57:06.673267 29189 ts_tablet_manager.cc:1397] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:57:06.674221 29190 raft_consensus.cc:348] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d34918edc7547cb9d19a584c35c0b93" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42231 } } peers { permanent_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42863 } } peers { permanent_uuid: "0246ae1733344ede8922ebc94459b192" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36493 } }
I20260806 00:57:06.674499 29190 raft_consensus.cc:374] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:06.674558 29190 raft_consensus.cc:729] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff0ff77c8bd4b098c01c3d5f0fcd8cb, State: Initialized, Role: FOLLOWER
I20260806 00:57:06.674685 29190 consensus_queue.cc:260] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d34918edc7547cb9d19a584c35c0b93" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42231 } } peers { permanent_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42863 } } peers { permanent_uuid: "0246ae1733344ede8922ebc94459b192" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36493 } }
I20260806 00:57:06.674989 29190 ts_tablet_manager.cc:1428] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:57:06.675159 29192 raft_consensus.cc:348] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d34918edc7547cb9d19a584c35c0b93" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42231 } } peers { permanent_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42863 } } peers { permanent_uuid: "0246ae1733344ede8922ebc94459b192" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36493 } }
I20260806 00:57:06.675194 29189 raft_consensus.cc:348] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d34918edc7547cb9d19a584c35c0b93" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42231 } } peers { permanent_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42863 } } peers { permanent_uuid: "0246ae1733344ede8922ebc94459b192" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36493 } }
I20260806 00:57:06.675343 29189 raft_consensus.cc:374] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:06.675343 29192 raft_consensus.cc:374] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:06.675382 29192 raft_consensus.cc:729] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d34918edc7547cb9d19a584c35c0b93, State: Initialized, Role: FOLLOWER
I20260806 00:57:06.675382 29189 raft_consensus.cc:729] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0246ae1733344ede8922ebc94459b192, State: Initialized, Role: FOLLOWER
I20260806 00:57:06.675495 29192 consensus_queue.cc:260] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d34918edc7547cb9d19a584c35c0b93" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42231 } } peers { permanent_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42863 } } peers { permanent_uuid: "0246ae1733344ede8922ebc94459b192" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36493 } }
I20260806 00:57:06.675495 29189 consensus_queue.cc:260] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d34918edc7547cb9d19a584c35c0b93" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42231 } } peers { permanent_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42863 } } peers { permanent_uuid: "0246ae1733344ede8922ebc94459b192" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36493 } }
I20260806 00:57:06.675786 28976 heartbeater.cc:503] Master 127.3.98.190:43685 was elected leader, sending a full tablet report...
I20260806 00:57:06.675858 29192 ts_tablet_manager.cc:1428] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:57:06.675904 29169 heartbeater.cc:503] Master 127.3.98.190:43685 was elected leader, sending a full tablet report...
I20260806 00:57:06.676218 29189 ts_tablet_manager.cc:1428] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:57:06.676465 28791 heartbeater.cc:503] Master 127.3.98.190:43685 was elected leader, sending a full tablet report...
W20260806 00:57:06.704069 28977 tablet.cc:2369] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 00:57:06.787643 28794 tablet.cc:2369] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 00:57:06.875524 29170 tablet.cc:2369] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:57:06.875537 29196 raft_consensus.cc:482] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:57:06.875701 29196 raft_consensus.cc:504] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d34918edc7547cb9d19a584c35c0b93" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42231 } } peers { permanent_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42863 } } peers { permanent_uuid: "0246ae1733344ede8922ebc94459b192" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36493 } }
I20260806 00:57:06.876189 29196 leader_election.cc:288] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d34918edc7547cb9d19a584c35c0b93 (127.3.98.131:42231), 0246ae1733344ede8922ebc94459b192 (127.3.98.129:36493)
I20260806 00:57:06.878647 29197 raft_consensus.cc:482] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:57:06.878752 29197 raft_consensus.cc:504] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d34918edc7547cb9d19a584c35c0b93" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42231 } } peers { permanent_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42863 } } peers { permanent_uuid: "0246ae1733344ede8922ebc94459b192" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36493 } }
I20260806 00:57:06.879112 29197 leader_election.cc:288] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aff0ff77c8bd4b098c01c3d5f0fcd8cb (127.3.98.130:42863), 0246ae1733344ede8922ebc94459b192 (127.3.98.129:36493)
I20260806 00:57:06.879392 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.876394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:42231 (local address 127.3.98.130:53255)
0806 00:57:06.876665 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:06.876674 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:06.876728 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:06.876853 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:06.876854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:06.876855 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:06.876927 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.876929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.877574 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.877575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.878343 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.878345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.879105 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.879106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.879173 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.879177 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:57:06.879232 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 00:57:06.879256 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":48,"thread_start_us":174,"threads_started":1}
I20260806 00:57:06.879401 29187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.876555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:53255 (local address 127.3.98.131:42231)
0806 00:57:06.876604 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:06.876606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:06.876743 (+ 137us) server_negotiation.cc:407] Connection header received
0806 00:57:06.876780 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:06.876781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:06.876791 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:06.876849 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:06.877009 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.877475 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.878440 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.878957 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.879057 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.879066 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:06.879275 (+ 209us) server_negotiation.cc:299] Negotiation successful
0806 00:57:06.879323 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 00:57:06.879591 28979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.876382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:36493 (local address 127.3.98.130:43835)
0806 00:57:06.876445 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:06.876460 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:06.876537 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:06.876758 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:06.876759 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:06.876761 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:06.876841 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.876843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.877495 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.877496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.878272 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.878274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.879049 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.879050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.879143 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.879148 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:57:06.879205 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 00:57:06.879254 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260806 00:57:06.879797 29100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af459bd2c4c643e08c6abbd6da58b074" candidate_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d34918edc7547cb9d19a584c35c0b93" is_pre_election: true
I20260806 00:57:06.879914 29100 raft_consensus.cc:2454] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff0ff77c8bd4b098c01c3d5f0fcd8cb in term 0.
I20260806 00:57:06.880157 29186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.876540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:43835 (local address 127.3.98.129:36493)
0806 00:57:06.876604 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:06.876606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:06.876616 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:57:06.876648 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:06.876649 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:06.876660 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:06.876750 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:06.876928 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.877412 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.878378 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.878963 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.879051 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.879061 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:06.880004 (+ 943us) server_negotiation.cc:299] Negotiation successful
0806 00:57:06.880060 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 00:57:06.880221 28822 leader_election.cc:302] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d34918edc7547cb9d19a584c35c0b93, aff0ff77c8bd4b098c01c3d5f0fcd8cb; no voters:
I20260806 00:57:06.880436 28723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af459bd2c4c643e08c6abbd6da58b074" candidate_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0246ae1733344ede8922ebc94459b192" is_pre_election: true
I20260806 00:57:06.880606 28723 raft_consensus.cc:2454] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aff0ff77c8bd4b098c01c3d5f0fcd8cb in term 0.
I20260806 00:57:06.880622 29196 raft_consensus.cc:2781] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:57:06.880676 29196 raft_consensus.cc:482] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:57:06.880702 29196 raft_consensus.cc:3037] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:06.881531 29196 raft_consensus.cc:504] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d34918edc7547cb9d19a584c35c0b93" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42231 } } peers { permanent_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42863 } } peers { permanent_uuid: "0246ae1733344ede8922ebc94459b192" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36493 } }
I20260806 00:57:06.881814 29100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af459bd2c4c643e08c6abbd6da58b074" candidate_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d34918edc7547cb9d19a584c35c0b93"
I20260806 00:57:06.881891 29100 raft_consensus.cc:3037] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:06.881933 28723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af459bd2c4c643e08c6abbd6da58b074" candidate_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0246ae1733344ede8922ebc94459b192"
I20260806 00:57:06.882012 28723 raft_consensus.cc:3037] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:06.882462 29196 leader_election.cc:288] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [CANDIDATE]: Term 1 election: Requested vote from peers 8d34918edc7547cb9d19a584c35c0b93 (127.3.98.131:42231), 0246ae1733344ede8922ebc94459b192 (127.3.98.129:36493)
I20260806 00:57:06.882771 29100 raft_consensus.cc:2454] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff0ff77c8bd4b098c01c3d5f0fcd8cb in term 1.
I20260806 00:57:06.882874 29171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.879228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:42863 (local address 127.3.98.131:52157)
0806 00:57:06.879295 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:06.879304 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:06.879338 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:06.879633 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:06.879634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:06.879636 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:06.879692 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.879694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.880542 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.880544 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.881672 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.881675 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.882616 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.882617 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.882699 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.882703 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:57:06.882758 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 00:57:06.882805 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260806 00:57:06.882941 28822 leader_election.cc:302] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d34918edc7547cb9d19a584c35c0b93, aff0ff77c8bd4b098c01c3d5f0fcd8cb; no voters:
I20260806 00:57:06.883042 29201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.879389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:36493 (local address 127.3.98.131:48299)
0806 00:57:06.879598 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:06.879609 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:06.879651 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:06.879978 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:06.879979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:06.879981 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:06.880053 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.880054 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.880918 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.880919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.881969 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:06.881971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.882766 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.882767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:06.882844 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.882849 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:57:06.882899 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 00:57:06.882939 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":107,"threads_started":1}
I20260806 00:57:06.883049 28723 raft_consensus.cc:2454] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aff0ff77c8bd4b098c01c3d5f0fcd8cb in term 1.
I20260806 00:57:06.883104 29196 raft_consensus.cc:2781] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:06.883256 29196 raft_consensus.cc:686] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [term 1 LEADER]: Becoming Leader. State: Replica: aff0ff77c8bd4b098c01c3d5f0fcd8cb, State: Running, Role: LEADER
I20260806 00:57:06.883280 29203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.879726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:48299 (local address 127.3.98.129:36493)
0806 00:57:06.879836 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:06.879838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:06.879845 (+ 7us) server_negotiation.cc:407] Connection header received
0806 00:57:06.879865 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:06.879866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:06.879874 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:06.879936 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:06.880125 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.880827 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.882079 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.882643 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.882719 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.882728 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:06.883134 (+ 406us) server_negotiation.cc:299] Negotiation successful
0806 00:57:06.883186 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":60,"threads_started":1}
I20260806 00:57:06.883356 29196 consensus_queue.cc:237] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d34918edc7547cb9d19a584c35c0b93" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42231 } } peers { permanent_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42863 } } peers { permanent_uuid: "0246ae1733344ede8922ebc94459b192" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36493 } }
I20260806 00:57:06.883425 29185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.879407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:52157 (local address 127.3.98.130:42863)
0806 00:57:06.879519 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:06.879521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:06.879530 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:57:06.879550 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:06.879551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:06.879559 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:06.879631 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:06.879754 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.880426 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.881758 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.882275 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.882349 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.882357 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:06.883278 (+ 921us) server_negotiation.cc:299] Negotiation successful
0806 00:57:06.883322 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260806 00:57:06.883424 28723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af459bd2c4c643e08c6abbd6da58b074" candidate_uuid: "8d34918edc7547cb9d19a584c35c0b93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0246ae1733344ede8922ebc94459b192" is_pre_election: true
I20260806 00:57:06.883527 28723 raft_consensus.cc:2379] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8d34918edc7547cb9d19a584c35c0b93 in current term 1: Already voted for candidate aff0ff77c8bd4b098c01c3d5f0fcd8cb in this term.
I20260806 00:57:06.883617 28916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af459bd2c4c643e08c6abbd6da58b074" candidate_uuid: "8d34918edc7547cb9d19a584c35c0b93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" is_pre_election: true
I20260806 00:57:06.883910 29007 leader_election.cc:302] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8d34918edc7547cb9d19a584c35c0b93; no voters: 0246ae1733344ede8922ebc94459b192, aff0ff77c8bd4b098c01c3d5f0fcd8cb
I20260806 00:57:06.884063 29197 raft_consensus.cc:2726] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 00:57:06.884694 28521 catalog_manager.cc:5495] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb reported cstate change: term changed from 0 to 1, leader changed from <none> to aff0ff77c8bd4b098c01c3d5f0fcd8cb (127.3.98.130). New cstate: current_term: 1 leader_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d34918edc7547cb9d19a584c35c0b93" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aff0ff77c8bd4b098c01c3d5f0fcd8cb" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0246ae1733344ede8922ebc94459b192" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36493 } health_report { overall_health: UNKNOWN } } }
I20260806 00:57:06.890641 29185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.888405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46626 (local address 127.3.98.130:42863)
0806 00:57:06.888457 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:06.888459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:06.888466 (+ 7us) server_negotiation.cc:407] Connection header received
0806 00:57:06.888582 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:06.888583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:06.888599 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:06.888651 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:06.888787 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.889223 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.889918 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:06.890097 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:06.890147 (+ 50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:06.890305 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:06.890391 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:06.890466 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:06.890511 (+ 45us) server_negotiation.cc:299] Negotiation successful
0806 00:57:06.890521 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 00:57:06.892315 28723 raft_consensus.cc:1261] T af459bd2c4c643e08c6abbd6da58b074 P 0246ae1733344ede8922ebc94459b192 [term 1 FOLLOWER]: Refusing update from remote peer aff0ff77c8bd4b098c01c3d5f0fcd8cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:06.892323 29100 raft_consensus.cc:1261] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [term 1 FOLLOWER]: Refusing update from remote peer aff0ff77c8bd4b098c01c3d5f0fcd8cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:06.892817 29196 consensus_queue.cc:1035] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0246ae1733344ede8922ebc94459b192" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 36493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:06.892993 29204 consensus_queue.cc:1035] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d34918edc7547cb9d19a584c35c0b93" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:06.895264 29210 mvcc.cc:205] Tried to move back new op lower bound from 7315365178948358144 to 7315365178916450304. Current Snapshot: MvccSnapshot[applied={T|T < 7315365178948358144}]
I20260806 00:57:06.895984 29211 mvcc.cc:205] Tried to move back new op lower bound from 7315365178948358144 to 7315365178916450304. Current Snapshot: MvccSnapshot[applied={T|T < 7315365178948358144 or (T in {7315365178948358144})}]
I20260806 00:57:06.897998 28518 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:57:06.898100 28518 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41174:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:57:06.898901 28518 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3924137316eb445ca440b867c5f05d95: Sending DeleteTablet for 3 replicas of tablet af459bd2c4c643e08c6abbd6da58b074
I20260806 00:57:06.899257 28692 tablet_service.cc:1514] Processing DeleteTablet for tablet af459bd2c4c643e08c6abbd6da58b074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:06 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:36674
I20260806 00:57:06.899262 28880 tablet_service.cc:1514] Processing DeleteTablet for tablet af459bd2c4c643e08c6abbd6da58b074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:06 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:46620
I20260806 00:57:06.899482 29072 tablet_service.cc:1514] Processing DeleteTablet for tablet af459bd2c4c643e08c6abbd6da58b074 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:06 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:53022
I20260806 00:57:06.899823 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 28606
I20260806 00:57:06.909197 29223 tablet_replica.cc:330] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb: stopping tablet replica
I20260806 00:57:06.909314 29223 raft_consensus.cc:2229] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:57:06.909396 29223 raft_consensus.cc:2258] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:57:06.911052 29223 ts_tablet_manager.cc:1905] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:57:06.912688 29223 ts_tablet_manager.cc:1918] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:57:06.912751 29223 log.cc:1196] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/af459bd2c4c643e08c6abbd6da58b074
I20260806 00:57:06.912999 29223 ts_tablet_manager.cc:1939] T af459bd2c4c643e08c6abbd6da58b074 P aff0ff77c8bd4b098c01c3d5f0fcd8cb: Deleting consensus metadata
I20260806 00:57:06.913371 28493 catalog_manager.cc:4841] TS aff0ff77c8bd4b098c01c3d5f0fcd8cb (127.3.98.130:42863): tablet af459bd2c4c643e08c6abbd6da58b074 (table test-table [id=d00d680f3cf745999704de66b640e091]) successfully deleted
I20260806 00:57:06.899752 29224 tablet_replica.cc:330] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93: stopping tablet replica
I20260806 00:57:06.926644 29224 raft_consensus.cc:2229] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:57:06.926792 29224 raft_consensus.cc:2258] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:57:06.927431 29224 ts_tablet_manager.cc:1905] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:57:06.929579 29224 ts_tablet_manager.cc:1918] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:57:06.929665 29224 log.cc:1196] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/af459bd2c4c643e08c6abbd6da58b074
W20260806 00:57:06.929944 28496 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:36493 (error 108)
I20260806 00:57:06.930256 29224 ts_tablet_manager.cc:1939] T af459bd2c4c643e08c6abbd6da58b074 P 8d34918edc7547cb9d19a584c35c0b93: Deleting consensus metadata
I20260806 00:57:06.930675 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 28799
I20260806 00:57:06.930737 28495 catalog_manager.cc:4841] TS 8d34918edc7547cb9d19a584c35c0b93 (127.3.98.131:42231): tablet af459bd2c4c643e08c6abbd6da58b074 (table test-table [id=d00d680f3cf745999704de66b640e091]) successfully deleted
I20260806 00:57:06.932284 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:06.930766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:36493 (local address 127.0.0.1:36678)
0806 00:57:06.932192 (+ 1426us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:06.932242 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:36493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1400}
W20260806 00:57:06.932818 28496 catalog_manager.cc:4584] TS 0246ae1733344ede8922ebc94459b192 (127.3.98.129:36493): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet af459bd2c4c643e08c6abbd6da58b074: Network error: Client connection negotiation failed: client connection to 127.3.98.129:36493: connect: Connection refused (error 111)
I20260806 00:57:06.939973 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 28982
I20260806 00:57:06.962939 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 28472
2026-08-06T00:57:06Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2367 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T00:57:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:06Z Disabled control of system clock
I20260806 00:57:06.996035 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:36223
--webserver_interface=127.3.98.190
--webserver_port=0
--builtin_ntp_servers=127.3.98.148:44515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:36223
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 00:57:07.077790 29232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:07.078028 29232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:07.078050 29232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:07.079211 29232 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:07.079255 29232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:07.079268 29232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:07.079309 29232 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:07.079340 29232 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:07.080693 29232 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:36223
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:36223
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:07.080955 29232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:07.081307 29232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:07.086284 29240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:07.086269 29243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:07.086409 29232 server_base.cc:1034] running on GCE node
W20260806 00:57:07.086268 29241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:07.086805 29232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:07.087075 29232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:07.088222 29232 hybrid_clock.cc:648] HybridClock initialized: now 1785977827088207 us; error 28 us; skew 500 ppm
I20260806 00:57:07.089433 29232 webserver.cc:460] Webserver started at http://127.3.98.190:46605/ using document root <none> and password file <none>
I20260806 00:57:07.089648 29232 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:07.089690 29232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:07.089781 29232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:07.090802 29232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "72f3c58994254865a6e9e412437f4713"
format_stamp: "Formatted at 2026-08-06 00:57:07 on dist-test-slave-44d2"
server_key: "fcb2597bd409abcb1e0e402a2e4fb467"
server_key_iv: "40d7214ced25cd479f88420b911e7b81"
server_key_version: "encryptionkey@0"
I20260806 00:57:07.091117 29232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "72f3c58994254865a6e9e412437f4713"
format_stamp: "Formatted at 2026-08-06 00:57:07 on dist-test-slave-44d2"
server_key: "fcb2597bd409abcb1e0e402a2e4fb467"
server_key_iv: "40d7214ced25cd479f88420b911e7b81"
server_key_version: "encryptionkey@0"
I20260806 00:57:07.092410 29232 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:07.093195 29255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:07.093377 29232 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:07.093467 29232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "72f3c58994254865a6e9e412437f4713"
format_stamp: "Formatted at 2026-08-06 00:57:07 on dist-test-slave-44d2"
server_key: "fcb2597bd409abcb1e0e402a2e4fb467"
server_key_iv: "40d7214ced25cd479f88420b911e7b81"
server_key_version: "encryptionkey@0"
I20260806 00:57:07.093523 29232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:07.145372 29232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:07.145722 29232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:07.145866 29232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:07.150653 29232 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:36223
I20260806 00:57:07.150689 29337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:36223 every 8 connection(s)
I20260806 00:57:07.151140 29232 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:07.152269 29338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:07.154614 29338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713: Bootstrap starting.
I20260806 00:57:07.155223 29338 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:07.155539 29338 log.cc:824] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:07.156296 29338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713: No bootstrap required, opened a new log
I20260806 00:57:07.157982 29338 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72f3c58994254865a6e9e412437f4713" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36223 } }
I20260806 00:57:07.158157 29338 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:07.158206 29338 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72f3c58994254865a6e9e412437f4713, State: Initialized, Role: FOLLOWER
I20260806 00:57:07.158397 29338 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72f3c58994254865a6e9e412437f4713" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36223 } }
I20260806 00:57:07.158502 29338 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:07.158557 29338 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:07.158609 29338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:07.159130 29338 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72f3c58994254865a6e9e412437f4713" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36223 } }
I20260806 00:57:07.159252 29338 leader_election.cc:302] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72f3c58994254865a6e9e412437f4713; no voters:
I20260806 00:57:07.159436 29338 leader_election.cc:288] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:07.159492 29342 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:07.159708 29338 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:07.159735 29342 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [term 1 LEADER]: Becoming Leader. State: Replica: 72f3c58994254865a6e9e412437f4713, State: Running, Role: LEADER
I20260806 00:57:07.159833 29342 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72f3c58994254865a6e9e412437f4713" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36223 } }
I20260806 00:57:07.160349 29343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72f3c58994254865a6e9e412437f4713" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72f3c58994254865a6e9e412437f4713" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36223 } } }
I20260806 00:57:07.160583 29344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72f3c58994254865a6e9e412437f4713. Latest consensus state: current_term: 1 leader_uuid: "72f3c58994254865a6e9e412437f4713" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72f3c58994254865a6e9e412437f4713" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36223 } } }
I20260806 00:57:07.160668 29343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:07.160689 29344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:07.161139 29357 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:07.161214 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 29232
I20260806 00:57:07.161324 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:07.161556 3466 external_mini_cluster.cc:1428] Setting key d6987351fe2381e134246a0004659e4d
I20260806 00:57:07.161779 29357 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:07.163537 29357 catalog_manager.cc:1347] Generated new cluster ID: 9f74bfcfe0004f41aa87fa37844ed7da
I20260806 00:57:07.163625 29357 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:07.168292 29372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.162075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53294 (local address 127.3.98.190:36223)
0806 00:57:07.162281 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:07.162290 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:07.162505 (+ 215us) server_negotiation.cc:407] Connection header received
0806 00:57:07.163029 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:07.163038 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:07.163110 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:07.163265 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:07.163528 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.164921 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.166005 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.166674 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.166808 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.167551 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:07.167556 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:07.167557 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:07.167774 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:07.167820 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:07.167835 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:07.167911 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:07.167973 (+ 62us) server_negotiation.cc:299] Negotiation successful
0806 00:57:07.168056 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":81,"threads_started":1}
I20260806 00:57:07.176954 29357 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:07.177462 29357 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:07.190326 29357 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713: Generated new TSK 0
I20260806 00:57:07.190522 29357 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:07.195930 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:36223
--builtin_ntp_servers=127.3.98.148:44515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 00:57:07.286273 29375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:07.286495 29375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:07.286520 29375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:07.287771 29375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:07.287842 29375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:07.287891 29375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:57:07.289476 29375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:36223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:07.289772 29375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:07.290097 29375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:07.296175 29385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:07.296211 29375 server_base.cc:1034] running on GCE node
W20260806 00:57:07.296175 29381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:07.296190 29383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:07.296672 29375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:07.297001 29375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:07.298162 29375 hybrid_clock.cc:648] HybridClock initialized: now 1785977827298158 us; error 38 us; skew 500 ppm
I20260806 00:57:07.299535 29375 webserver.cc:460] Webserver started at http://127.3.98.129:41743/ using document root <none> and password file <none>
I20260806 00:57:07.299817 29375 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:07.299889 29375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:07.300063 29375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:07.301258 29375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "cc08a8f8316842e7810f5d3202500e66"
format_stamp: "Formatted at 2026-08-06 00:57:07 on dist-test-slave-44d2"
server_key: "06c47e308fba1a41300f0aebcd441e49"
server_key_iv: "442434d56006e72719fb935c9098b333"
server_key_version: "encryptionkey@0"
I20260806 00:57:07.301707 29375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "cc08a8f8316842e7810f5d3202500e66"
format_stamp: "Formatted at 2026-08-06 00:57:07 on dist-test-slave-44d2"
server_key: "06c47e308fba1a41300f0aebcd441e49"
server_key_iv: "442434d56006e72719fb935c9098b333"
server_key_version: "encryptionkey@0"
I20260806 00:57:07.303084 29375 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 00:57:07.303804 29394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:07.303990 29375 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:07.304093 29375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "cc08a8f8316842e7810f5d3202500e66"
format_stamp: "Formatted at 2026-08-06 00:57:07 on dist-test-slave-44d2"
server_key: "06c47e308fba1a41300f0aebcd441e49"
server_key_iv: "442434d56006e72719fb935c9098b333"
server_key_version: "encryptionkey@0"
I20260806 00:57:07.304181 29375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:07.318928 29375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:07.319240 29375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:07.319394 29375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:07.319638 29375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:07.319994 29375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:07.320050 29375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:07.320086 29375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:07.320158 29375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:07.326148 29375 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:37971
I20260806 00:57:07.326224 29545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:37971 every 8 connection(s)
I20260806 00:57:07.326570 29375 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:57:07.331677 29372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.327373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:56237 (local address 127.3.98.190:36223)
0806 00:57:07.327446 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:07.327448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:07.327652 (+ 204us) server_negotiation.cc:407] Connection header received
0806 00:57:07.328120 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:07.328121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:07.328136 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:07.328192 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:07.328947 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.329443 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.330406 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.330608 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.330659 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.331420 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:07.331422 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:07.331422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:07.331427 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:07.331441 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:07.331445 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:07.331488 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:07.331591 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 00:57:07.331617 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 00:57:07.331871 29549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.327320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:36223 (local address 127.3.98.129:56237)
0806 00:57:07.327524 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:07.327564 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:07.328036 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:07.328252 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:07.328256 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:07.328264 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:07.328864 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.328870 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.329543 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.329544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.330327 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.330329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.330686 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.330687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.330796 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.331288 (+ 492us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:57:07.331289 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:07.331318 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:57:07.331341 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:07.331500 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:07.331505 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:07.331507 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:57:07.331566 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 00:57:07.331644 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
I20260806 00:57:07.332146 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 29375
I20260806 00:57:07.332266 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:57:07.332520 3466 external_mini_cluster.cc:1428] Setting key 2cee541aa590306b1a2520c1e76e3463
I20260806 00:57:07.332453 29546 heartbeater.cc:347] Connected to a master server at 127.3.98.190:36223
I20260806 00:57:07.332607 29546 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:07.332815 29546 heartbeater.cc:511] Master 127.3.98.190:36223 requested a full tablet report, sending...
I20260806 00:57:07.333410 29281 ts_manager.cc:194] Registered new tserver with Master: cc08a8f8316842e7810f5d3202500e66 (127.3.98.129:37971)
I20260806 00:57:07.333688 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:36223
--builtin_ntp_servers=127.3.98.148:44515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 00:57:07.334334 29281 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.98.129:56237
W20260806 00:57:07.418352 29552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:07.418566 29552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:07.418588 29552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:07.419785 29552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:07.419829 29552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:07.419855 29552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:57:07.421262 29552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:36223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:07.421523 29552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:07.421839 29552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:07.426929 29561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:07.426929 29560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:07.426955 29563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:07.427024 29552 server_base.cc:1034] running on GCE node
I20260806 00:57:07.427435 29552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:07.427685 29552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:07.428853 29552 hybrid_clock.cc:648] HybridClock initialized: now 1785977827428839 us; error 25 us; skew 500 ppm
I20260806 00:57:07.430126 29552 webserver.cc:460] Webserver started at http://127.3.98.130:33399/ using document root <none> and password file <none>
I20260806 00:57:07.430393 29552 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:07.430465 29552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:07.430625 29552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:07.431741 29552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "28126b078b80409fb38b3258a74e348d"
format_stamp: "Formatted at 2026-08-06 00:57:07 on dist-test-slave-44d2"
server_key: "233c9668a2530007f9d9f94d28a8a65b"
server_key_iv: "8fc18f48f482c9fa473d4ee50aee4df7"
server_key_version: "encryptionkey@0"
I20260806 00:57:07.432161 29552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "28126b078b80409fb38b3258a74e348d"
format_stamp: "Formatted at 2026-08-06 00:57:07 on dist-test-slave-44d2"
server_key: "233c9668a2530007f9d9f94d28a8a65b"
server_key_iv: "8fc18f48f482c9fa473d4ee50aee4df7"
server_key_version: "encryptionkey@0"
I20260806 00:57:07.433609 29552 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:57:07.434355 29572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:07.434525 29552 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:57:07.434631 29552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "28126b078b80409fb38b3258a74e348d"
format_stamp: "Formatted at 2026-08-06 00:57:07 on dist-test-slave-44d2"
server_key: "233c9668a2530007f9d9f94d28a8a65b"
server_key_iv: "8fc18f48f482c9fa473d4ee50aee4df7"
server_key_version: "encryptionkey@0"
I20260806 00:57:07.434710 29552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:07.451066 29552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:07.451450 29552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:07.451618 29552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:07.451855 29552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:07.452204 29552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:07.452260 29552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:07.452301 29552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:07.452329 29552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:07.458355 29552 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:35477
I20260806 00:57:07.458405 29729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:35477 every 8 connection(s)
I20260806 00:57:07.458745 29552 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:57:07.459391 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 29552
I20260806 00:57:07.459548 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:57:07.459806 3466 external_mini_cluster.cc:1428] Setting key 0916bc4288792a2dd3f3d36702828c71
I20260806 00:57:07.461045 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:36223
--builtin_ntp_servers=127.3.98.148:44515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 00:57:07.465152 29372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.459500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:52817 (local address 127.3.98.190:36223)
0806 00:57:07.459562 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:07.459583 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:07.459844 (+ 261us) server_negotiation.cc:407] Connection header received
0806 00:57:07.460405 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:07.460406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:07.460418 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:07.460506 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:07.461386 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.462139 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.463439 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.463637 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.463696 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.464765 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:07.464766 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:07.464767 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:07.464773 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:07.464792 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:07.464797 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:07.464865 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:07.464994 (+ 129us) server_negotiation.cc:299] Negotiation successful
0806 00:57:07.465030 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 00:57:07.465246 29732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.459472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:36223 (local address 127.3.98.130:52817)
0806 00:57:07.459712 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:07.459757 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:07.460307 (+ 550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:07.460606 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:07.460610 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:07.460619 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:07.461294 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.461300 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.462245 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.462245 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.463346 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.463349 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.463725 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.463726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.463889 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.464610 (+ 721us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:57:07.464611 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:07.464643 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:57:07.464668 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:07.464900 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:07.464902 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:07.464905 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:57:07.464963 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 00:57:07.465047 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":111,"threads_started":1}
I20260806 00:57:07.465758 29730 heartbeater.cc:347] Connected to a master server at 127.3.98.190:36223
I20260806 00:57:07.465874 29730 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:07.466089 29730 heartbeater.cc:511] Master 127.3.98.190:36223 requested a full tablet report, sending...
I20260806 00:57:07.466519 29281 ts_manager.cc:194] Registered new tserver with Master: 28126b078b80409fb38b3258a74e348d (127.3.98.130:35477)
I20260806 00:57:07.467064 29281 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.98.130:52817
W20260806 00:57:07.551622 29733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:07.551862 29733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:07.551888 29733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:07.553161 29733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:07.553215 29733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:07.553246 29733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:57:07.554705 29733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:44515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:36223
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:07.554944 29733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:07.555233 29733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:07.560433 29742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:07.560411 29739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:07.560477 29738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:07.560747 29733 server_base.cc:1034] running on GCE node
I20260806 00:57:07.561031 29733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:07.561369 29733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:07.562584 29733 hybrid_clock.cc:648] HybridClock initialized: now 1785977827562565 us; error 29 us; skew 500 ppm
I20260806 00:57:07.563838 29733 webserver.cc:460] Webserver started at http://127.3.98.131:37895/ using document root <none> and password file <none>
I20260806 00:57:07.564108 29733 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:07.564184 29733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:07.564338 29733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:07.565464 29733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "4b49d3f4edb74ad7b3def69e7d459071"
format_stamp: "Formatted at 2026-08-06 00:57:07 on dist-test-slave-44d2"
server_key: "aa6c2cfe342e2ce4585b02c6a451cc41"
server_key_iv: "19de1f7ce00fb2077ff3308ea373333e"
server_key_version: "encryptionkey@0"
I20260806 00:57:07.565856 29733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "4b49d3f4edb74ad7b3def69e7d459071"
format_stamp: "Formatted at 2026-08-06 00:57:07 on dist-test-slave-44d2"
server_key: "aa6c2cfe342e2ce4585b02c6a451cc41"
server_key_iv: "19de1f7ce00fb2077ff3308ea373333e"
server_key_version: "encryptionkey@0"
I20260806 00:57:07.567240 29733 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:57:07.568028 29749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:07.568219 29733 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:07.568329 29733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "4b49d3f4edb74ad7b3def69e7d459071"
format_stamp: "Formatted at 2026-08-06 00:57:07 on dist-test-slave-44d2"
server_key: "aa6c2cfe342e2ce4585b02c6a451cc41"
server_key_iv: "19de1f7ce00fb2077ff3308ea373333e"
server_key_version: "encryptionkey@0"
I20260806 00:57:07.568405 29733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:07.597786 29733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:07.598338 29733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:07.598484 29733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:07.598747 29733 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:07.599123 29733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:07.599182 29733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:07.599233 29733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:07.599257 29733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:07.607524 29733 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:45779
I20260806 00:57:07.607556 29910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:45779 every 8 connection(s)
I20260806 00:57:07.608042 29733 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:57:07.609643 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 29733
I20260806 00:57:07.609789 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:57:07.610051 3466 external_mini_cluster.cc:1428] Setting key 804606d41e0406ce727128ec8e7be66b
I20260806 00:57:07.616923 29372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.611088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:55495 (local address 127.3.98.190:36223)
0806 00:57:07.611134 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:07.611136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:07.611237 (+ 101us) server_negotiation.cc:407] Connection header received
0806 00:57:07.611902 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:07.611903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:07.611916 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:07.611957 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:07.612841 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.613617 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.615067 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.615265 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.615330 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.616370 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:07.616372 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:07.616372 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:07.616377 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:07.616396 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:07.616401 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:07.616472 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:07.616642 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 00:57:07.616677 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:57:07.617182 29913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.609970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:36223 (local address 127.3.98.131:55495)
0806 00:57:07.611065 (+ 1095us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:07.611145 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:07.611791 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:07.612049 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:07.612053 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:07.612071 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:07.612741 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.612749 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.613733 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.613735 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.614965 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.614969 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.615364 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.615365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.615542 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.616156 (+ 614us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:57:07.616157 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:07.616205 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:57:07.616242 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:07.616550 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:07.616558 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:07.616562 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:57:07.616646 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 00:57:07.616775 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1015,"thread_start_us":919,"threads_started":1}
I20260806 00:57:07.617727 29911 heartbeater.cc:347] Connected to a master server at 127.3.98.190:36223
I20260806 00:57:07.617874 29911 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:07.618114 29911 heartbeater.cc:511] Master 127.3.98.190:36223 requested a full tablet report, sending...
I20260806 00:57:07.618628 29281 ts_manager.cc:194] Registered new tserver with Master: 4b49d3f4edb74ad7b3def69e7d459071 (127.3.98.131:45779)
I20260806 00:57:07.619253 29281 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.98.131:55495
I20260806 00:57:07.623461 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:57:07.630371 29372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.625753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53298 (local address 127.3.98.190:36223)
0806 00:57:07.625822 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:07.625824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:07.625984 (+ 160us) server_negotiation.cc:407] Connection header received
0806 00:57:07.626081 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:07.626082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:07.626098 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:07.626169 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:07.626388 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.627136 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.628503 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.628875 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.628937 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.630066 (+ 1129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:07.630068 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:07.630068 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:07.630074 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:07.630090 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:07.630094 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:07.630180 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:07.630281 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 00:57:07.630292 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 00:57:07.632601 29281 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53298:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:57:07.635653 29281 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:57:07.643448 29919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.638517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:37971 (local address 127.0.0.1:52706)
0806 00:57:07.638673 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:07.638717 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:07.638790 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:07.639262 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:07.639266 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:07.639269 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:07.639369 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.639372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.641066 (+ 1694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.641067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.642079 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.642081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.643101 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.643102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.643202 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.643217 (+ 15us) client_negotiation.cc:769] Sending connection context
0806 00:57:07.643268 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 00:57:07.643326 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":90,"threads_started":1}
I20260806 00:57:07.643883 29923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.638518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:45779 (local address 127.0.0.1:43984)
0806 00:57:07.638891 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:07.638903 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:07.638940 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:07.639474 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:07.639475 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:07.639477 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:07.639525 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.639526 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.640948 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.640949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.642240 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.642242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.643175 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.643177 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.643259 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.643265 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 00:57:07.643326 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 00:57:07.643377 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":5,"thread_start_us":85,"threads_started":1}
I20260806 00:57:07.643950 29924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.638736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52706 (local address 127.3.98.129:37971)
0806 00:57:07.638958 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:07.638963 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:07.638979 (+ 16us) server_negotiation.cc:407] Connection header received
0806 00:57:07.639039 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:07.639042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:07.639061 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:07.639165 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:07.639482 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.640947 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.642168 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.642985 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.643674 (+ 689us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.643775 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:07.643803 (+ 28us) server_negotiation.cc:299] Negotiation successful
0806 00:57:07.643846 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":118,"threads_started":1}
I20260806 00:57:07.644225 29928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.638988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43984 (local address 127.3.98.131:45779)
0806 00:57:07.639316 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:07.639319 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:07.639328 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:57:07.639367 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:07.639370 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:07.639386 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:07.639474 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:07.639590 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.640859 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.642340 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.643100 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.643171 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.643276 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:07.644068 (+ 792us) server_negotiation.cc:299] Negotiation successful
0806 00:57:07.644120 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":94,"threads_started":1}
I20260806 00:57:07.644764 29458 tablet_service.cc:1467] Processing CreateTablet for tablet f83d2c5e499647869eaecddfd2bcdbe0 (DEFAULT_TABLE table=test-table [id=a31c8042da2941ebb9096dbf6308a386]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:07.644958 29820 tablet_service.cc:1467] Processing CreateTablet for tablet f83d2c5e499647869eaecddfd2bcdbe0 (DEFAULT_TABLE table=test-table [id=a31c8042da2941ebb9096dbf6308a386]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:07.645195 29458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f83d2c5e499647869eaecddfd2bcdbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:07.645272 29820 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f83d2c5e499647869eaecddfd2bcdbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:07.649360 29930 tablet_bootstrap.cc:492] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071: Bootstrap starting.
I20260806 00:57:07.649351 29929 tablet_bootstrap.cc:492] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66: Bootstrap starting.
I20260806 00:57:07.650112 29930 tablet_bootstrap.cc:654] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:07.650238 29929 tablet_bootstrap.cc:654] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:07.650477 29930 log.cc:824] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:07.650539 29925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.638774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:35477 (local address 127.0.0.1:52512)
0806 00:57:07.639187 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:07.639199 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:07.639551 (+ 352us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:07.639950 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:07.639951 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:07.639953 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:07.640013 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.640015 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.641550 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.641551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.642645 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.642647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.650258 (+ 7611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.650259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.650335 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.650340 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:57:07.650411 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 00:57:07.650458 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":113,"threads_started":1}
I20260806 00:57:07.650563 29927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.638960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52512 (local address 127.3.98.130:35477)
0806 00:57:07.639173 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:07.639178 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:07.639260 (+ 82us) server_negotiation.cc:407] Connection header received
0806 00:57:07.639692 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:07.639696 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:07.639715 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:07.639799 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:07.640118 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.641478 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.643315 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.650130 (+ 6815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.650252 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.650362 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:07.650426 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 00:57:07.650467 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":108,"threads_started":1}
I20260806 00:57:07.650906 29929 log.cc:824] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:07.651292 29930 tablet_bootstrap.cc:492] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071: No bootstrap required, opened a new log
I20260806 00:57:07.651396 29930 ts_tablet_manager.cc:1397] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:57:07.651312 29643 tablet_service.cc:1467] Processing CreateTablet for tablet f83d2c5e499647869eaecddfd2bcdbe0 (DEFAULT_TABLE table=test-table [id=a31c8042da2941ebb9096dbf6308a386]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:07.651719 29643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f83d2c5e499647869eaecddfd2bcdbe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:07.651961 29929 tablet_bootstrap.cc:492] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66: No bootstrap required, opened a new log
I20260806 00:57:07.652078 29929 ts_tablet_manager.cc:1397] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 00:57:07.654440 29930 raft_consensus.cc:348] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc08a8f8316842e7810f5d3202500e66" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37971 } } peers { permanent_uuid: "4b49d3f4edb74ad7b3def69e7d459071" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45779 } } peers { permanent_uuid: "28126b078b80409fb38b3258a74e348d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 35477 } }
I20260806 00:57:07.654639 29930 raft_consensus.cc:374] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:07.654696 29930 raft_consensus.cc:729] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b49d3f4edb74ad7b3def69e7d459071, State: Initialized, Role: FOLLOWER
I20260806 00:57:07.654855 29930 consensus_queue.cc:260] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc08a8f8316842e7810f5d3202500e66" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37971 } } peers { permanent_uuid: "4b49d3f4edb74ad7b3def69e7d459071" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45779 } } peers { permanent_uuid: "28126b078b80409fb38b3258a74e348d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 35477 } }
I20260806 00:57:07.655176 29930 ts_tablet_manager.cc:1428] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260806 00:57:07.655218 29911 heartbeater.cc:503] Master 127.3.98.190:36223 was elected leader, sending a full tablet report...
I20260806 00:57:07.655895 29929 raft_consensus.cc:348] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc08a8f8316842e7810f5d3202500e66" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37971 } } peers { permanent_uuid: "4b49d3f4edb74ad7b3def69e7d459071" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45779 } } peers { permanent_uuid: "28126b078b80409fb38b3258a74e348d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 35477 } }
I20260806 00:57:07.656139 29929 raft_consensus.cc:374] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:07.656243 29929 raft_consensus.cc:729] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc08a8f8316842e7810f5d3202500e66, State: Initialized, Role: FOLLOWER
I20260806 00:57:07.656390 29937 tablet_bootstrap.cc:492] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d: Bootstrap starting.
I20260806 00:57:07.656421 29929 consensus_queue.cc:260] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc08a8f8316842e7810f5d3202500e66" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37971 } } peers { permanent_uuid: "4b49d3f4edb74ad7b3def69e7d459071" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45779 } } peers { permanent_uuid: "28126b078b80409fb38b3258a74e348d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 35477 } }
I20260806 00:57:07.656872 29929 ts_tablet_manager.cc:1428] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260806 00:57:07.656940 29546 heartbeater.cc:503] Master 127.3.98.190:36223 was elected leader, sending a full tablet report...
I20260806 00:57:07.657308 29937 tablet_bootstrap.cc:654] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:07.657672 29937 log.cc:824] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:07.658483 29937 tablet_bootstrap.cc:492] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d: No bootstrap required, opened a new log
I20260806 00:57:07.658548 29937 ts_tablet_manager.cc:1397] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:57:07.661124 29937 raft_consensus.cc:348] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc08a8f8316842e7810f5d3202500e66" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37971 } } peers { permanent_uuid: "4b49d3f4edb74ad7b3def69e7d459071" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45779 } } peers { permanent_uuid: "28126b078b80409fb38b3258a74e348d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 35477 } }
I20260806 00:57:07.661288 29937 raft_consensus.cc:374] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:07.661366 29937 raft_consensus.cc:729] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28126b078b80409fb38b3258a74e348d, State: Initialized, Role: FOLLOWER
I20260806 00:57:07.661461 29937 consensus_queue.cc:260] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc08a8f8316842e7810f5d3202500e66" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37971 } } peers { permanent_uuid: "4b49d3f4edb74ad7b3def69e7d459071" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45779 } } peers { permanent_uuid: "28126b078b80409fb38b3258a74e348d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 35477 } }
I20260806 00:57:07.661715 29937 ts_tablet_manager.cc:1428] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:57:07.661791 29730 heartbeater.cc:503] Master 127.3.98.190:36223 was elected leader, sending a full tablet report...
W20260806 00:57:07.709319 29731 tablet.cc:2369] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:57:07.812647 29941 raft_consensus.cc:482] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:57:07.812824 29941 raft_consensus.cc:504] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc08a8f8316842e7810f5d3202500e66" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37971 } } peers { permanent_uuid: "4b49d3f4edb74ad7b3def69e7d459071" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45779 } } peers { permanent_uuid: "28126b078b80409fb38b3258a74e348d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 35477 } }
I20260806 00:57:07.813269 29941 leader_election.cc:288] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc08a8f8316842e7810f5d3202500e66 (127.3.98.129:37971), 4b49d3f4edb74ad7b3def69e7d459071 (127.3.98.131:45779)
I20260806 00:57:07.816198 29928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.813635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:33519 (local address 127.3.98.131:45779)
0806 00:57:07.813706 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:07.813708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:07.813737 (+ 29us) server_negotiation.cc:407] Connection header received
0806 00:57:07.813772 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:07.813773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:07.813781 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:07.813848 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:07.814026 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.814469 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.815461 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.815828 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.815887 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.815893 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:07.816080 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 00:57:07.816127 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 00:57:07.816202 29942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.813472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:45779 (local address 127.3.98.130:33519)
0806 00:57:07.813667 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:07.813678 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:07.813724 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:07.813854 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:07.813854 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:07.813855 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:07.813946 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.813948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.814559 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.814560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.815356 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.815358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.815919 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.815920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.815997 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.816007 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 00:57:07.816051 (+ 44us) client_negotiation.cc:240] Negotiation successful
0806 00:57:07.816086 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":122,"threads_started":1}
I20260806 00:57:07.816263 29924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.813533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:48755 (local address 127.3.98.129:37971)
0806 00:57:07.813584 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:07.813586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:07.813625 (+ 39us) server_negotiation.cc:407] Connection header received
0806 00:57:07.813661 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:07.813662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:07.813675 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:07.813738 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:07.813945 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.814474 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.815459 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.815849 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.815946 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.815954 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:07.816141 (+ 187us) server_negotiation.cc:299] Negotiation successful
0806 00:57:07.816185 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 00:57:07.816291 29732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.813453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:37971 (local address 127.3.98.130:48755)
0806 00:57:07.813522 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:07.813534 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:07.813581 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:07.813760 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:07.813761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:07.813763 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:07.813846 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.813848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.814583 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.814584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.815353 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:07.815355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.815967 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.815968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:07.816050 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.816054 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:57:07.816115 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 00:57:07.816152 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 00:57:07.816709 29847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83d2c5e499647869eaecddfd2bcdbe0" candidate_uuid: "28126b078b80409fb38b3258a74e348d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b49d3f4edb74ad7b3def69e7d459071" is_pre_election: true
I20260806 00:57:07.816771 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83d2c5e499647869eaecddfd2bcdbe0" candidate_uuid: "28126b078b80409fb38b3258a74e348d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc08a8f8316842e7810f5d3202500e66" is_pre_election: true
I20260806 00:57:07.816875 29847 raft_consensus.cc:2454] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28126b078b80409fb38b3258a74e348d in term 0.
I20260806 00:57:07.816953 29486 raft_consensus.cc:2454] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28126b078b80409fb38b3258a74e348d in term 0.
I20260806 00:57:07.817147 29575 leader_election.cc:302] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28126b078b80409fb38b3258a74e348d, 4b49d3f4edb74ad7b3def69e7d459071; no voters:
I20260806 00:57:07.817297 29941 raft_consensus.cc:2781] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:57:07.817358 29941 raft_consensus.cc:482] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:57:07.817381 29941 raft_consensus.cc:3037] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:07.818089 29941 raft_consensus.cc:504] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc08a8f8316842e7810f5d3202500e66" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37971 } } peers { permanent_uuid: "4b49d3f4edb74ad7b3def69e7d459071" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45779 } } peers { permanent_uuid: "28126b078b80409fb38b3258a74e348d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 35477 } }
I20260806 00:57:07.818236 29941 leader_election.cc:288] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [CANDIDATE]: Term 1 election: Requested vote from peers cc08a8f8316842e7810f5d3202500e66 (127.3.98.129:37971), 4b49d3f4edb74ad7b3def69e7d459071 (127.3.98.131:45779)
I20260806 00:57:07.818396 29486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83d2c5e499647869eaecddfd2bcdbe0" candidate_uuid: "28126b078b80409fb38b3258a74e348d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc08a8f8316842e7810f5d3202500e66"
I20260806 00:57:07.818418 29847 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f83d2c5e499647869eaecddfd2bcdbe0" candidate_uuid: "28126b078b80409fb38b3258a74e348d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b49d3f4edb74ad7b3def69e7d459071"
I20260806 00:57:07.818496 29486 raft_consensus.cc:3037] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:07.818492 29847 raft_consensus.cc:3037] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:07.819485 29847 raft_consensus.cc:2454] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28126b078b80409fb38b3258a74e348d in term 1.
I20260806 00:57:07.819532 29486 raft_consensus.cc:2454] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28126b078b80409fb38b3258a74e348d in term 1.
I20260806 00:57:07.819659 29575 leader_election.cc:302] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28126b078b80409fb38b3258a74e348d, 4b49d3f4edb74ad7b3def69e7d459071; no voters:
I20260806 00:57:07.819757 29941 raft_consensus.cc:2781] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:07.819914 29941 raft_consensus.cc:686] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [term 1 LEADER]: Becoming Leader. State: Replica: 28126b078b80409fb38b3258a74e348d, State: Running, Role: LEADER
I20260806 00:57:07.820039 29941 consensus_queue.cc:237] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc08a8f8316842e7810f5d3202500e66" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37971 } } peers { permanent_uuid: "4b49d3f4edb74ad7b3def69e7d459071" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45779 } } peers { permanent_uuid: "28126b078b80409fb38b3258a74e348d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 35477 } }
I20260806 00:57:07.820945 29281 catalog_manager.cc:5495] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d reported cstate change: term changed from 0 to 1, leader changed from <none> to 28126b078b80409fb38b3258a74e348d (127.3.98.130). New cstate: current_term: 1 leader_uuid: "28126b078b80409fb38b3258a74e348d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc08a8f8316842e7810f5d3202500e66" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b49d3f4edb74ad7b3def69e7d459071" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28126b078b80409fb38b3258a74e348d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 35477 } health_report { overall_health: HEALTHY } } }
W20260806 00:57:07.827281 29548 tablet.cc:2369] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 00:57:07.861513 29912 tablet.cc:2369] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:57:07.869045 29927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.866674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52518 (local address 127.3.98.130:35477)
0806 00:57:07.866768 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:07.866770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:07.866781 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:57:07.866821 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:07.866822 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:07.866846 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:07.866923 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:07.867058 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.867537 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.868248 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:07.868428 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:07.868551 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:07.868671 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:07.868758 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:07.868837 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:07.868882 (+ 45us) server_negotiation.cc:299] Negotiation successful
0806 00:57:07.868892 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 00:57:07.871016 29486 raft_consensus.cc:1261] T f83d2c5e499647869eaecddfd2bcdbe0 P cc08a8f8316842e7810f5d3202500e66 [term 1 FOLLOWER]: Refusing update from remote peer 28126b078b80409fb38b3258a74e348d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:07.871037 29847 raft_consensus.cc:1261] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071 [term 1 FOLLOWER]: Refusing update from remote peer 28126b078b80409fb38b3258a74e348d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:07.871549 29943 consensus_queue.cc:1035] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b49d3f4edb74ad7b3def69e7d459071" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 45779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:07.871696 29941 consensus_queue.cc:1035] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc08a8f8316842e7810f5d3202500e66" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:07.874321 29950 mvcc.cc:205] Tried to move back new op lower bound from 7315365182956490752 to 7315365182751481856. Current Snapshot: MvccSnapshot[applied={T|T < 7315365182956490752}]
I20260806 00:57:07.874402 29949 mvcc.cc:205] Tried to move back new op lower bound from 7315365182956490752 to 7315365182751481856. Current Snapshot: MvccSnapshot[applied={T|T < 7315365182956490752}]
I20260806 00:57:07.877015 29282 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:57:07.877118 29282 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:57:07.878002 29282 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 72f3c58994254865a6e9e412437f4713: Sending DeleteTablet for 3 replicas of tablet f83d2c5e499647869eaecddfd2bcdbe0
I20260806 00:57:07.878505 29458 tablet_service.cc:1514] Processing DeleteTablet for tablet f83d2c5e499647869eaecddfd2bcdbe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:07 UTC) from {username='slave'} at 127.0.0.1:52706
I20260806 00:57:07.878525 29643 tablet_service.cc:1514] Processing DeleteTablet for tablet f83d2c5e499647869eaecddfd2bcdbe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:07 UTC) from {username='slave'} at 127.0.0.1:52512
I20260806 00:57:07.878773 29820 tablet_service.cc:1514] Processing DeleteTablet for tablet f83d2c5e499647869eaecddfd2bcdbe0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:07 UTC) from {username='slave'} at 127.0.0.1:43984
I20260806 00:57:07.878996 29965 tablet_replica.cc:330] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071: stopping tablet replica
I20260806 00:57:07.879092 29963 tablet_replica.cc:330] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d: stopping tablet replica
I20260806 00:57:07.879204 29963 raft_consensus.cc:2229] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:57:07.879295 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 29375
I20260806 00:57:07.879350 29963 raft_consensus.cc:2258] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:57:07.879190 29965 raft_consensus.cc:2229] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:57:07.879606 29965 raft_consensus.cc:2258] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:57:07.880115 29965 ts_tablet_manager.cc:1905] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:57:07.881943 29965 ts_tablet_manager.cc:1918] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:57:07.882078 29965 log.cc:1196] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/f83d2c5e499647869eaecddfd2bcdbe0
I20260806 00:57:07.882429 29965 ts_tablet_manager.cc:1939] T f83d2c5e499647869eaecddfd2bcdbe0 P 4b49d3f4edb74ad7b3def69e7d459071: Deleting consensus metadata
I20260806 00:57:07.885286 29260 catalog_manager.cc:4841] TS 4b49d3f4edb74ad7b3def69e7d459071 (127.3.98.131:45779): tablet f83d2c5e499647869eaecddfd2bcdbe0 (table test-table [id=a31c8042da2941ebb9096dbf6308a386]) successfully deleted
I20260806 00:57:07.886412 29963 ts_tablet_manager.cc:1905] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:57:07.888697 29963 ts_tablet_manager.cc:1918] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:57:07.888810 29963 log.cc:1196] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/f83d2c5e499647869eaecddfd2bcdbe0
I20260806 00:57:07.889115 29963 ts_tablet_manager.cc:1939] T f83d2c5e499647869eaecddfd2bcdbe0 P 28126b078b80409fb38b3258a74e348d: Deleting consensus metadata
I20260806 00:57:07.889581 29260 catalog_manager.cc:4841] TS 28126b078b80409fb38b3258a74e348d (127.3.98.130:35477): tablet f83d2c5e499647869eaecddfd2bcdbe0 (table test-table [id=a31c8042da2941ebb9096dbf6308a386]) successfully deleted
W20260806 00:57:07.894555 29258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:37971 (error 108)
I20260806 00:57:07.894728 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 29552
I20260806 00:57:07.896672 29925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:07.896521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:37971 (local address 127.0.0.1:52712)
0806 00:57:07.896576 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:07.896626 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:37971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 00:57:07.896795 29258 catalog_manager.cc:4584] TS cc08a8f8316842e7810f5d3202500e66 (127.3.98.129:37971): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f83d2c5e499647869eaecddfd2bcdbe0: Network error: Client connection negotiation failed: client connection to 127.3.98.129:37971: connect: Connection refused (error 111)
I20260806 00:57:07.902853 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 29733
I20260806 00:57:07.913561 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 29232
2026-08-06T00:57:07Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (950 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:07 dist-test-slave-44d2 krb5kdc[29972](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:07 dist-test-slave-44d2 krb5kdc[29972](info): set up 2 sockets
Aug 06 00:57:07 dist-test-slave-44d2 krb5kdc[29972](info): commencing operation
krb5kdc: starting...
W20260806 00:57:09.134506 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.197s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:09 dist-test-slave-44d2 krb5kdc[29972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:57:09.257489 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:35029
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:35029
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:09.340781 29998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:09.340981 29998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:09.341002 29998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:09.342080 29998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:09.342116 29998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:09.342130 29998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:09.342142 29998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:09.342154 29998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:09.343580 29998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:35029
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:35029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:09.343772 29998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:09.343940 29998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:09.348922 30005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:09.348909 30004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:09.348909 30009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:09.349345 29998 server_base.cc:1034] running on GCE node
I20260806 00:57:09.349581 29998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:09.349858 29998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:09.351028 29998 hybrid_clock.cc:648] HybridClock initialized: now 1785977829351022 us; error 37 us; skew 500 ppm
Aug 06 00:57:09 dist-test-slave-44d2 krb5kdc[29972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977829, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:09.353564 29998 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:57:09.353988 29998 webserver.cc:460] Webserver started at http://127.3.98.190:38153/ using document root <none> and password file <none>
I20260806 00:57:09.354242 29998 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:09.354311 29998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:09.354456 29998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:09.355492 29998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "50ca11fccbed411abf70cd6fc67a4653"
format_stamp: "Formatted at 2026-08-06 00:57:09 on dist-test-slave-44d2"
server_key: "f7dc196248902edf4f178018e33a2fd4"
server_key_iv: "8c8d49fe4be193398a7f1e23eb02b38a"
server_key_version: "encryptionkey@0"
I20260806 00:57:09.355862 29998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "50ca11fccbed411abf70cd6fc67a4653"
format_stamp: "Formatted at 2026-08-06 00:57:09 on dist-test-slave-44d2"
server_key: "f7dc196248902edf4f178018e33a2fd4"
server_key_iv: "8c8d49fe4be193398a7f1e23eb02b38a"
server_key_version: "encryptionkey@0"
I20260806 00:57:09.357288 29998 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:57:09.357980 30017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:09.358152 29998 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:09.358256 29998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "50ca11fccbed411abf70cd6fc67a4653"
format_stamp: "Formatted at 2026-08-06 00:57:09 on dist-test-slave-44d2"
server_key: "f7dc196248902edf4f178018e33a2fd4"
server_key_iv: "8c8d49fe4be193398a7f1e23eb02b38a"
server_key_version: "encryptionkey@0"
I20260806 00:57:09.358330 29998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:09.371781 29998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:09.373775 29998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:09.373890 29998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:09.378017 29998 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:35029
I20260806 00:57:09.378055 30085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:35029 every 8 connection(s)
I20260806 00:57:09.378429 29998 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:09.379372 30086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:09.381826 30086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653: Bootstrap starting.
I20260806 00:57:09.382499 30086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:09.382815 30086 log.cc:824] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:09.383090 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 29998
I20260806 00:57:09.383227 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:09.383421 3466 external_mini_cluster.cc:1428] Setting key ddf6334862ba04f5653daa32c91005fe
I20260806 00:57:09.383654 30086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653: No bootstrap required, opened a new log
I20260806 00:57:09.386143 30086 raft_consensus.cc:348] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ca11fccbed411abf70cd6fc67a4653" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35029 } }
I20260806 00:57:09.386276 30086 raft_consensus.cc:374] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:09.386298 30086 raft_consensus.cc:729] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50ca11fccbed411abf70cd6fc67a4653, State: Initialized, Role: FOLLOWER
I20260806 00:57:09.386428 30086 consensus_queue.cc:260] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ca11fccbed411abf70cd6fc67a4653" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35029 } }
I20260806 00:57:09.386502 30086 raft_consensus.cc:388] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:09.386528 30086 raft_consensus.cc:482] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:09.386601 30086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:09.387157 30086 raft_consensus.cc:504] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ca11fccbed411abf70cd6fc67a4653" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35029 } }
I20260806 00:57:09.387246 30086 leader_election.cc:302] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 50ca11fccbed411abf70cd6fc67a4653; no voters:
I20260806 00:57:09.387454 30086 leader_election.cc:288] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:09.387737 30091 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:09.387790 30086 sys_catalog.cc:564] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:09.387907 30091 raft_consensus.cc:686] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [term 1 LEADER]: Becoming Leader. State: Replica: 50ca11fccbed411abf70cd6fc67a4653, State: Running, Role: LEADER
I20260806 00:57:09.388072 30091 consensus_queue.cc:237] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ca11fccbed411abf70cd6fc67a4653" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35029 } }
I20260806 00:57:09.388455 30091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "50ca11fccbed411abf70cd6fc67a4653" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ca11fccbed411abf70cd6fc67a4653" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35029 } } }
I20260806 00:57:09.388659 30091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:09.388840 30091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 50ca11fccbed411abf70cd6fc67a4653. Latest consensus state: current_term: 1 leader_uuid: "50ca11fccbed411abf70cd6fc67a4653" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "50ca11fccbed411abf70cd6fc67a4653" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 35029 } } }
I20260806 00:57:09.388963 30091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:09.389147 30105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:09.389741 30105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:09.392729 30105 catalog_manager.cc:1347] Generated new cluster ID: 82d9a80f721c44b9b094ee4fea9bbab8
I20260806 00:57:09.392812 30105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:57:09 dist-test-slave-44d2 krb5kdc[29972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:09.399056 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.384118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52648 (local address 127.3.98.190:35029)
0806 00:57:09.384315 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:09.384322 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:09.384348 (+ 26us) server_negotiation.cc:407] Connection header received
0806 00:57:09.385100 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:09.385108 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:09.385159 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:09.385272 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:09.386097 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.387536 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.389030 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.390038 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.390146 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.394984 (+ 4838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:09.394989 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:09.394989 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:09.395001 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:09.397063 (+ 2062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:09.397482 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:09.397485 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:09.397485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:09.397602 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:09.397829 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:09.397830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:09.397830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:09.398132 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:09.398262 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:09.398563 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 00:57:09.398705 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":114,"threads_started":1}
I20260806 00:57:09.406810 30105 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:09.407320 30105 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:09.414309 30105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653: Generated new TSK 0
I20260806 00:57:09.414503 30105 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.98.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
Entry for principal kudu/127.3.98.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab.
I20260806 00:57:09.447487 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35029
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:09.531369 30121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:09.531596 30121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:09.531636 30121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:09.532884 30121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:09.532948 30121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:09.532994 30121 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:57:09.534461 30121 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.129.keytab
--principal=kudu/127.3.98.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:09.534729 30121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:09.534961 30121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:09.540042 30127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:09.540117 30128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:09.540244 30121 server_base.cc:1034] running on GCE node
W20260806 00:57:09.540052 30131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:09.540634 30121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:09.540881 30121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:09.542052 30121 hybrid_clock.cc:648] HybridClock initialized: now 1785977829542032 us; error 51 us; skew 500 ppm
Aug 06 00:57:09 dist-test-slave-44d2 krb5kdc[29972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977829, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:09.544723 30121 init.cc:377] Logged in from keytab as kudu/127.3.98.129@KRBTEST.COM (short username kudu)
I20260806 00:57:09.545245 30121 webserver.cc:460] Webserver started at http://127.3.98.129:33699/ using document root <none> and password file <none>
I20260806 00:57:09.545507 30121 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:09.545578 30121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:09.545722 30121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:09.546795 30121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "d463a7b2c10f42e0aebf0c0e4b1345de"
format_stamp: "Formatted at 2026-08-06 00:57:09 on dist-test-slave-44d2"
server_key: "bfda86965f34f484c435d1e6fa9eebad"
server_key_iv: "d6c657b0c7ce3384159e27aef29fd551"
server_key_version: "encryptionkey@0"
I20260806 00:57:09.547165 30121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "d463a7b2c10f42e0aebf0c0e4b1345de"
format_stamp: "Formatted at 2026-08-06 00:57:09 on dist-test-slave-44d2"
server_key: "bfda86965f34f484c435d1e6fa9eebad"
server_key_iv: "d6c657b0c7ce3384159e27aef29fd551"
server_key_version: "encryptionkey@0"
I20260806 00:57:09.548652 30121 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:57:09.549415 30142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:09.549609 30121 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 00:57:09.549715 30121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "d463a7b2c10f42e0aebf0c0e4b1345de"
format_stamp: "Formatted at 2026-08-06 00:57:09 on dist-test-slave-44d2"
server_key: "bfda86965f34f484c435d1e6fa9eebad"
server_key_iv: "d6c657b0c7ce3384159e27aef29fd551"
server_key_version: "encryptionkey@0"
I20260806 00:57:09.549800 30121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:09.575735 30121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:09.577827 30121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:09.578014 30121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:09.578281 30121 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:09.578629 30121 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:09.578686 30121 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:09.578722 30121 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:09.578771 30121 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:09.585089 30121 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:44521
I20260806 00:57:09.585147 30298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:44521 every 8 connection(s)
I20260806 00:57:09.585474 30121 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
Aug 06 00:57:09 dist-test-slave-44d2 krb5kdc[29972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977829, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.129@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:09.593255 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 30121
I20260806 00:57:09.593413 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:57:09.593622 3466 external_mini_cluster.cc:1428] Setting key 95f0acbc751edeaeee1ffbccd0b4c187
I20260806 00:57:09.595507 30302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.586249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35029 (local address 127.3.98.129:52751)
0806 00:57:09.586433 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:09.586472 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:09.586958 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:09.587171 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:09.587174 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:09.587752 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:09.587989 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:09.587996 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.588819 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.588820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:09.589723 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:09.589726 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.590103 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.590104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:09.590205 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.590673 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:09.590682 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:09.592110 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:09.594062 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:09.594070 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:09.594073 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:09.594357 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:09.594605 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:09.594606 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:09.594606 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:09.594713 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:09.595004 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:09.595009 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:09.595131 (+ 122us) client_negotiation.cc:769] Sending connection context
0806 00:57:09.595216 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 00:57:09.595342 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":93,"threads_started":1}
I20260806 00:57:09.595513 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.586270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:52751 (local address 127.3.98.190:35029)
0806 00:57:09.586324 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:09.586326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:09.586579 (+ 253us) server_negotiation.cc:407] Connection header received
0806 00:57:09.587043 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:09.587044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:09.587054 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:09.587114 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:09.588088 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.588664 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.589805 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.590016 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.590077 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.592201 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:09.592203 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:09.592203 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:09.592210 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:09.593973 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:09.594448 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:09.594449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:09.594450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:09.594523 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:09.594781 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:09.594782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:09.594783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:09.594934 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:09.595007 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:09.595263 (+ 256us) server_negotiation.cc:299] Negotiation successful
0806 00:57:09.595369 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:57:09.596032 30299 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35029
I20260806 00:57:09.596146 30299 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:09.596360 30299 heartbeater.cc:511] Master 127.3.98.190:35029 requested a full tablet report, sending...
I20260806 00:57:09.597009 30038 ts_manager.cc:194] Registered new tserver with Master: d463a7b2c10f42e0aebf0c0e4b1345de (127.3.98.129:44521)
I20260806 00:57:09.597975 30038 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.129@KRBTEST.COM'} at 127.3.98.129:52751
WARNING: no policy specified for kudu/127.3.98.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
Entry for principal kudu/127.3.98.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab.
I20260806 00:57:09.619583 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35029
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:09.703917 30306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:09.704176 30306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:09.704221 30306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:09.705459 30306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:09.705538 30306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:09.705588 30306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:57:09.707094 30306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.130.keytab
--principal=kudu/127.3.98.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:09.707387 30306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:09.707643 30306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:09.712873 30316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:09.712999 30313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:09.713073 30306 server_base.cc:1034] running on GCE node
W20260806 00:57:09.712904 30314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:09.713410 30306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:09.713676 30306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:09.714874 30306 hybrid_clock.cc:648] HybridClock initialized: now 1785977829714861 us; error 55 us; skew 500 ppm
Aug 06 00:57:09 dist-test-slave-44d2 krb5kdc[29972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977829, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:09.717449 30306 init.cc:377] Logged in from keytab as kudu/127.3.98.130@KRBTEST.COM (short username kudu)
I20260806 00:57:09.717934 30306 webserver.cc:460] Webserver started at http://127.3.98.130:45577/ using document root <none> and password file <none>
I20260806 00:57:09.718189 30306 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:09.718261 30306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:09.718415 30306 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:09.719520 30306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "161c8adb088846cfb3be19a5c8f6927d"
format_stamp: "Formatted at 2026-08-06 00:57:09 on dist-test-slave-44d2"
server_key: "c0353ca8588b39eb8c04792a54031534"
server_key_iv: "ff81ad57d80cd3afeff5eb1580d2fab3"
server_key_version: "encryptionkey@0"
I20260806 00:57:09.719887 30306 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "161c8adb088846cfb3be19a5c8f6927d"
format_stamp: "Formatted at 2026-08-06 00:57:09 on dist-test-slave-44d2"
server_key: "c0353ca8588b39eb8c04792a54031534"
server_key_iv: "ff81ad57d80cd3afeff5eb1580d2fab3"
server_key_version: "encryptionkey@0"
I20260806 00:57:09.721305 30306 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:09.722035 30324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:09.722208 30306 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:09.722317 30306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "161c8adb088846cfb3be19a5c8f6927d"
format_stamp: "Formatted at 2026-08-06 00:57:09 on dist-test-slave-44d2"
server_key: "c0353ca8588b39eb8c04792a54031534"
server_key_iv: "ff81ad57d80cd3afeff5eb1580d2fab3"
server_key_version: "encryptionkey@0"
I20260806 00:57:09.722391 30306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:09.736187 30306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:09.738227 30306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:09.738408 30306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:09.738639 30306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:09.738950 30306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:09.739003 30306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:09.739037 30306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:09.739074 30306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:09.745026 30306 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:42413
I20260806 00:57:09.745079 30485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:42413 every 8 connection(s)
I20260806 00:57:09.745393 30306 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
Aug 06 00:57:09 dist-test-slave-44d2 krb5kdc[29972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977829, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.130@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:09.754726 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.746096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:59883 (local address 127.3.98.190:35029)
0806 00:57:09.746156 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:09.746158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:09.746369 (+ 211us) server_negotiation.cc:407] Connection header received
0806 00:57:09.746892 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:09.746894 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:09.746907 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:09.746972 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:09.747924 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.748441 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.749504 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.749712 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.749801 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.751874 (+ 2073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:09.751876 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:09.751877 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:09.751884 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:09.753241 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:09.753736 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:09.753737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:09.753737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:09.753792 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:09.754061 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:09.754062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:09.754063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:09.754181 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:09.754255 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:09.754561 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 00:57:09.754659 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 00:57:09.754853 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 30306
I20260806 00:57:09.754968 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:57:09.755023 30490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.746078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35029 (local address 127.3.98.130:59883)
0806 00:57:09.746246 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:09.746288 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:09.746784 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:09.747043 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:09.747048 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:09.747630 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:09.747820 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:09.747826 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.748594 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.748595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:09.749393 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:09.749395 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.749816 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.749817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:09.749953 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.750407 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:09.750415 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:09.751776 (+ 1361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:09.753329 (+ 1553us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:09.753337 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:09.753340 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:09.753570 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:09.753865 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:09.753865 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:09.753866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:09.753987 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:09.754257 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:09.754266 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:09.754403 (+ 137us) client_negotiation.cc:769] Sending connection context
0806 00:57:09.754528 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 00:57:09.754696 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":81,"threads_started":1}
I20260806 00:57:09.755194 3466 external_mini_cluster.cc:1428] Setting key ea1f168272a113c1a62e53007e293f1e
I20260806 00:57:09.755673 30488 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35029
I20260806 00:57:09.755795 30488 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:09.755999 30488 heartbeater.cc:511] Master 127.3.98.190:35029 requested a full tablet report, sending...
I20260806 00:57:09.756395 30038 ts_manager.cc:194] Registered new tserver with Master: 161c8adb088846cfb3be19a5c8f6927d (127.3.98.130:42413)
I20260806 00:57:09.756804 30038 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.130@KRBTEST.COM'} at 127.3.98.130:59883
WARNING: no policy specified for kudu/127.3.98.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
Entry for principal kudu/127.3.98.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab.
I20260806 00:57:09.781250 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35029
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:43333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:09.864548 30495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:09.864751 30495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:09.864775 30495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:09.865921 30495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:09.865963 30495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:09.866014 30495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:57:09.867594 30495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:43333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.131.keytab
--principal=kudu/127.3.98.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:35029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:09.867837 30495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:09.868068 30495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:09.873189 30504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:09.873281 30501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:09.873203 30502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:09.873438 30495 server_base.cc:1034] running on GCE node
I20260806 00:57:09.873656 30495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:09.873904 30495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:09.875085 30495 hybrid_clock.cc:648] HybridClock initialized: now 1785977829875079 us; error 38 us; skew 500 ppm
Aug 06 00:57:09 dist-test-slave-44d2 krb5kdc[29972](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977829, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:09.877759 30495 init.cc:377] Logged in from keytab as kudu/127.3.98.131@KRBTEST.COM (short username kudu)
I20260806 00:57:09.878162 30495 webserver.cc:460] Webserver started at http://127.3.98.131:36447/ using document root <none> and password file <none>
I20260806 00:57:09.878363 30495 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:09.878408 30495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:09.878499 30495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:09.879485 30495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "b243c2505aaf430a929ba79984fae366"
format_stamp: "Formatted at 2026-08-06 00:57:09 on dist-test-slave-44d2"
server_key: "c5323f997242d75c99ae1a7c2c924c48"
server_key_iv: "0c63603f026276d06ea72bbbdbdc94ef"
server_key_version: "encryptionkey@0"
I20260806 00:57:09.879792 30495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "b243c2505aaf430a929ba79984fae366"
format_stamp: "Formatted at 2026-08-06 00:57:09 on dist-test-slave-44d2"
server_key: "c5323f997242d75c99ae1a7c2c924c48"
server_key_iv: "0c63603f026276d06ea72bbbdbdc94ef"
server_key_version: "encryptionkey@0"
I20260806 00:57:09.881151 30495 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:09.881861 30513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:09.882054 30495 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:09.882129 30495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "b243c2505aaf430a929ba79984fae366"
format_stamp: "Formatted at 2026-08-06 00:57:09 on dist-test-slave-44d2"
server_key: "c5323f997242d75c99ae1a7c2c924c48"
server_key_iv: "0c63603f026276d06ea72bbbdbdc94ef"
server_key_version: "encryptionkey@0"
I20260806 00:57:09.882223 30495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:09.899158 30495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:09.901368 30495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:09.901485 30495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:09.901660 30495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:09.901978 30495 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:09.902014 30495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:09.902035 30495 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:09.902047 30495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:09.907997 30495 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:38451
I20260806 00:57:09.908049 30660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:38451 every 8 connection(s)
I20260806 00:57:09.908423 30495 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
Aug 06 00:57:09 dist-test-slave-44d2 krb5kdc[29972](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977829, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.131@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:09.916982 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 30495
I20260806 00:57:09.917109 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:57:09.917340 3466 external_mini_cluster.cc:1428] Setting key ef1815b35868fd76b384305606b86662
I20260806 00:57:09.917915 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.909256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:50851 (local address 127.3.98.190:35029)
0806 00:57:09.909330 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:09.909333 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:09.909511 (+ 178us) server_negotiation.cc:407] Connection header received
0806 00:57:09.909989 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:09.909991 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:09.910001 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:09.910055 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:09.910950 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.911446 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.912452 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.912730 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.912789 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.915021 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:09.915022 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:09.915023 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:09.915030 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:09.916253 (+ 1223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:09.916714 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:09.916715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:09.916716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:09.916773 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:09.917106 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:09.917107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:09.917108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:09.917249 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:09.917318 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:09.917717 (+ 399us) server_negotiation.cc:299] Negotiation successful
0806 00:57:09.917807 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 00:57:09.918105 30664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.909211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:35029 (local address 127.3.98.131:50851)
0806 00:57:09.909381 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:09.909422 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:09.909905 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:09.910114 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:09.910118 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:09.910675 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:09.910874 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:09.910878 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.911529 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.911530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:09.912365 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:09.912366 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.912807 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.912808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:09.912910 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.913458 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:09.913467 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:09.914934 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:09.916330 (+ 1396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:09.916337 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:09.916339 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:09.916645 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:09.916865 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:09.916866 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:09.916866 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:09.917021 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:09.917329 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:09.917336 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:09.917503 (+ 167us) client_negotiation.cc:769] Sending connection context
0806 00:57:09.917655 (+ 152us) client_negotiation.cc:240] Negotiation successful
0806 00:57:09.917843 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
I20260806 00:57:09.918612 30662 heartbeater.cc:347] Connected to a master server at 127.3.98.190:35029
I20260806 00:57:09.918706 30662 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:09.918848 30662 heartbeater.cc:511] Master 127.3.98.190:35029 requested a full tablet report, sending...
I20260806 00:57:09.919216 30038 ts_manager.cc:194] Registered new tserver with Master: b243c2505aaf430a929ba79984fae366 (127.3.98.131:38451)
I20260806 00:57:09.919616 30038 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.98.131@KRBTEST.COM'} at 127.3.98.131:50851
I20260806 00:57:09.929195 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:57:09.936546 30090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.930554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52650 (local address 127.3.98.190:35029)
0806 00:57:09.930626 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:09.930628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:09.930737 (+ 109us) server_negotiation.cc:407] Connection header received
0806 00:57:09.930824 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:09.930824 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:09.930836 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:09.930887 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:09.931434 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.931925 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.932742 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.932940 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.933021 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.934139 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:09.934140 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:09.934141 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:09.934148 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:09.935286 (+ 1138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:09.935640 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:09.935642 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:09.935642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:09.935705 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:09.935903 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:09.935904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:09.935904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:09.936064 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:09.936172 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:09.936314 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 00:57:09.936401 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 00:57:09.937999 30038 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52650:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:57:09.939651 30038 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:57:09.946197 30675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.942070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:44521 (local address 127.0.0.1:40108)
0806 00:57:09.942243 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:09.942284 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:09.942372 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:09.942747 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:09.942751 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:09.942754 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:09.942826 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:09.942828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.943873 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.943874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:09.944915 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:09.944918 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.945880 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.945881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:09.945978 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.945992 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 00:57:09.946070 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 00:57:09.946121 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":87,"threads_started":1}
I20260806 00:57:09.946226 30678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.942251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40108 (local address 127.3.98.129:44521)
0806 00:57:09.942462 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:09.942468 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:09.942479 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:57:09.942524 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:09.942526 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:09.942592 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:09.942787 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:09.942913 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.943768 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.945024 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.945801 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.945868 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.945928 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:09.946099 (+ 171us) server_negotiation.cc:299] Negotiation successful
0806 00:57:09.946145 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":87,"threads_started":1}
I20260806 00:57:09.946815 30681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.942494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59572 (local address 127.3.98.131:38451)
0806 00:57:09.942691 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:09.942696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:09.942753 (+ 57us) server_negotiation.cc:407] Connection header received
0806 00:57:09.942951 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:09.942954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:09.942971 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:09.943027 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:09.943291 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.944434 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.945653 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.946393 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.946465 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.946519 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:09.946699 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 00:57:09.946739 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":99,"threads_started":1}
I20260806 00:57:09.946964 30680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.942353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:42413 (local address 127.0.0.1:52406)
0806 00:57:09.942906 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:09.942915 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:09.942964 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:09.943195 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:09.943196 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:09.943198 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:09.943243 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:09.943245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.944566 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.944567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:09.945695 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:09.945698 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.946728 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.946729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:09.946789 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.946793 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:57:09.946843 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 00:57:09.946884 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"mutex_wait_us":54,"thread_start_us":71,"threads_started":1}
I20260806 00:57:09.947057 30676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.942113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:38451 (local address 127.0.0.1:59572)
0806 00:57:09.942688 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:09.942698 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:09.942843 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:09.943142 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:09.943143 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:09.943145 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:09.943200 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:09.943202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.944580 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.944582 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:09.945544 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:09.945548 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.946469 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.946470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:09.946535 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.946539 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:57:09.946890 (+ 351us) client_negotiation.cc:240] Negotiation successful
0806 00:57:09.946951 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":119,"threads_started":1}
I20260806 00:57:09.946935 30206 tablet_service.cc:1467] Processing CreateTablet for tablet 441a39797a6a405e9f9d9cb429e4905f (DEFAULT_TABLE table=test-table [id=4b6d700ed69f44afa8de1405e104797a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:09.947194 30682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:09.942496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52406 (local address 127.3.98.130:42413)
0806 00:57:09.942775 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:09.942779 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:09.943032 (+ 253us) server_negotiation.cc:407] Connection header received
0806 00:57:09.943082 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:09.943085 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:09.943100 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:09.943180 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:09.943329 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.944412 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.945802 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:09.946568 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:09.946637 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:09.946691 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:09.947078 (+ 387us) server_negotiation.cc:299] Negotiation successful
0806 00:57:09.947123 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":123,"threads_started":1}
I20260806 00:57:09.947345 30206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 441a39797a6a405e9f9d9cb429e4905f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:09.947916 30395 tablet_service.cc:1467] Processing CreateTablet for tablet 441a39797a6a405e9f9d9cb429e4905f (DEFAULT_TABLE table=test-table [id=4b6d700ed69f44afa8de1405e104797a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:09.948249 30395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 441a39797a6a405e9f9d9cb429e4905f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:09.950212 30684 tablet_bootstrap.cc:492] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de: Bootstrap starting.
I20260806 00:57:09.950712 30569 tablet_service.cc:1467] Processing CreateTablet for tablet 441a39797a6a405e9f9d9cb429e4905f (DEFAULT_TABLE table=test-table [id=4b6d700ed69f44afa8de1405e104797a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:09.950912 30684 tablet_bootstrap.cc:654] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:09.951067 30569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 441a39797a6a405e9f9d9cb429e4905f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:09.951530 30684 log.cc:824] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:09.952382 30684 tablet_bootstrap.cc:492] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de: No bootstrap required, opened a new log
I20260806 00:57:09.952461 30684 ts_tablet_manager.cc:1397] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 00:57:09.954535 30691 tablet_bootstrap.cc:492] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366: Bootstrap starting.
I20260806 00:57:09.954661 30686 tablet_bootstrap.cc:492] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d: Bootstrap starting.
I20260806 00:57:09.954630 30684 raft_consensus.cc:348] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d463a7b2c10f42e0aebf0c0e4b1345de" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44521 } } peers { permanent_uuid: "b243c2505aaf430a929ba79984fae366" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38451 } } peers { permanent_uuid: "161c8adb088846cfb3be19a5c8f6927d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42413 } }
I20260806 00:57:09.954819 30684 raft_consensus.cc:374] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:09.954865 30684 raft_consensus.cc:729] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d463a7b2c10f42e0aebf0c0e4b1345de, State: Initialized, Role: FOLLOWER
I20260806 00:57:09.954996 30684 consensus_queue.cc:260] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d463a7b2c10f42e0aebf0c0e4b1345de" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44521 } } peers { permanent_uuid: "b243c2505aaf430a929ba79984fae366" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38451 } } peers { permanent_uuid: "161c8adb088846cfb3be19a5c8f6927d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42413 } }
I20260806 00:57:09.955299 30684 ts_tablet_manager.cc:1428] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 00:57:09.955391 30691 tablet_bootstrap.cc:654] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:09.955438 30299 heartbeater.cc:503] Master 127.3.98.190:35029 was elected leader, sending a full tablet report...
I20260806 00:57:09.955386 30686 tablet_bootstrap.cc:654] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:09.956022 30691 log.cc:824] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:09.956348 30686 log.cc:824] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:09.956907 30691 tablet_bootstrap.cc:492] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366: No bootstrap required, opened a new log
I20260806 00:57:09.956990 30691 ts_tablet_manager.cc:1397] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 00:57:09.957325 30686 tablet_bootstrap.cc:492] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d: No bootstrap required, opened a new log
I20260806 00:57:09.957412 30686 ts_tablet_manager.cc:1397] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 00:57:09.958541 30691 raft_consensus.cc:348] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d463a7b2c10f42e0aebf0c0e4b1345de" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44521 } } peers { permanent_uuid: "b243c2505aaf430a929ba79984fae366" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38451 } } peers { permanent_uuid: "161c8adb088846cfb3be19a5c8f6927d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42413 } }
I20260806 00:57:09.958734 30691 raft_consensus.cc:374] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:09.958762 30691 raft_consensus.cc:729] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b243c2505aaf430a929ba79984fae366, State: Initialized, Role: FOLLOWER
I20260806 00:57:09.958895 30691 consensus_queue.cc:260] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d463a7b2c10f42e0aebf0c0e4b1345de" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44521 } } peers { permanent_uuid: "b243c2505aaf430a929ba79984fae366" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38451 } } peers { permanent_uuid: "161c8adb088846cfb3be19a5c8f6927d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42413 } }
I20260806 00:57:09.959241 30691 ts_tablet_manager.cc:1428] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 00:57:09.959270 30662 heartbeater.cc:503] Master 127.3.98.190:35029 was elected leader, sending a full tablet report...
I20260806 00:57:09.959257 30686 raft_consensus.cc:348] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d463a7b2c10f42e0aebf0c0e4b1345de" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44521 } } peers { permanent_uuid: "b243c2505aaf430a929ba79984fae366" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38451 } } peers { permanent_uuid: "161c8adb088846cfb3be19a5c8f6927d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42413 } }
I20260806 00:57:09.959450 30686 raft_consensus.cc:374] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:09.959504 30686 raft_consensus.cc:729] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161c8adb088846cfb3be19a5c8f6927d, State: Initialized, Role: FOLLOWER
I20260806 00:57:09.959626 30686 consensus_queue.cc:260] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d463a7b2c10f42e0aebf0c0e4b1345de" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44521 } } peers { permanent_uuid: "b243c2505aaf430a929ba79984fae366" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38451 } } peers { permanent_uuid: "161c8adb088846cfb3be19a5c8f6927d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42413 } }
I20260806 00:57:09.959942 30686 ts_tablet_manager.cc:1428] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 00:57:09.960107 30488 heartbeater.cc:503] Master 127.3.98.190:35029 was elected leader, sending a full tablet report...
W20260806 00:57:09.996035 30489 tablet.cc:2369] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:57:10.020993 30697 raft_consensus.cc:482] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:57:10.021163 30697 raft_consensus.cc:504] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d463a7b2c10f42e0aebf0c0e4b1345de" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44521 } } peers { permanent_uuid: "b243c2505aaf430a929ba79984fae366" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38451 } } peers { permanent_uuid: "161c8adb088846cfb3be19a5c8f6927d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42413 } }
I20260806 00:57:10.021581 30697 leader_election.cc:288] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d463a7b2c10f42e0aebf0c0e4b1345de (127.3.98.129:44521), b243c2505aaf430a929ba79984fae366 (127.3.98.131:38451)
I20260806 00:57:10.025516 30678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.021903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:49435 (local address 127.3.98.129:44521)
0806 00:57:10.021977 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.021979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.021990 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:57:10.022023 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.022024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.022038 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.022118 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:10.022290 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.023056 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.024545 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.025139 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.025214 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.025224 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.025391 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.025440 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 00:57:10.025502 30490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.021777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:44521 (local address 127.3.98.130:49435)
0806 00:57:10.021847 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:10.021859 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:10.021912 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:10.022126 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:10.022128 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:10.022130 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:10.022213 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.022215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.023153 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.023154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.024430 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.024433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.025229 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.025230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.025295 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.025299 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:57:10.025366 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 00:57:10.025409 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":34}
I20260806 00:57:10.025599 30681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.022035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:56531 (local address 127.3.98.131:38451)
0806 00:57:10.022099 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.022102 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.022151 (+ 49us) server_negotiation.cc:407] Connection header received
0806 00:57:10.022223 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.022224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.022231 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.022302 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:10.022465 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.023156 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.024576 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.025152 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.025214 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.025224 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.025477 (+ 253us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.025524 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 00:57:10.025684 30698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.021847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:38451 (local address 127.3.98.130:56531)
0806 00:57:10.022087 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:10.022098 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:10.022156 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:10.022329 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:10.022330 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:10.022332 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:10.022393 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.022394 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.023229 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.023229 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.024430 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.024433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.025278 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.025280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.025397 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.025402 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:57:10.025458 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 00:57:10.025498 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":6,"thread_start_us":168,"threads_started":1}
I20260806 00:57:10.025903 30232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441a39797a6a405e9f9d9cb429e4905f" candidate_uuid: "161c8adb088846cfb3be19a5c8f6927d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d463a7b2c10f42e0aebf0c0e4b1345de" is_pre_election: true
I20260806 00:57:10.026039 30232 raft_consensus.cc:2454] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161c8adb088846cfb3be19a5c8f6927d in term 0.
I20260806 00:57:10.026284 30329 leader_election.cc:302] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161c8adb088846cfb3be19a5c8f6927d, d463a7b2c10f42e0aebf0c0e4b1345de; no voters:
I20260806 00:57:10.026378 30600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441a39797a6a405e9f9d9cb429e4905f" candidate_uuid: "161c8adb088846cfb3be19a5c8f6927d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b243c2505aaf430a929ba79984fae366" is_pre_election: true
I20260806 00:57:10.026445 30697 raft_consensus.cc:2781] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:57:10.026536 30697 raft_consensus.cc:482] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:57:10.026532 30600 raft_consensus.cc:2454] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161c8adb088846cfb3be19a5c8f6927d in term 0.
I20260806 00:57:10.026578 30697 raft_consensus.cc:3037] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:10.027331 30697 raft_consensus.cc:504] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d463a7b2c10f42e0aebf0c0e4b1345de" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44521 } } peers { permanent_uuid: "b243c2505aaf430a929ba79984fae366" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38451 } } peers { permanent_uuid: "161c8adb088846cfb3be19a5c8f6927d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42413 } }
I20260806 00:57:10.027477 30697 leader_election.cc:288] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [CANDIDATE]: Term 1 election: Requested vote from peers d463a7b2c10f42e0aebf0c0e4b1345de (127.3.98.129:44521), b243c2505aaf430a929ba79984fae366 (127.3.98.131:38451)
I20260806 00:57:10.027657 30232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441a39797a6a405e9f9d9cb429e4905f" candidate_uuid: "161c8adb088846cfb3be19a5c8f6927d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d463a7b2c10f42e0aebf0c0e4b1345de"
I20260806 00:57:10.027683 30600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "441a39797a6a405e9f9d9cb429e4905f" candidate_uuid: "161c8adb088846cfb3be19a5c8f6927d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b243c2505aaf430a929ba79984fae366"
I20260806 00:57:10.027747 30600 raft_consensus.cc:3037] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:10.027741 30232 raft_consensus.cc:3037] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:10.028709 30600 raft_consensus.cc:2454] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161c8adb088846cfb3be19a5c8f6927d in term 1.
I20260806 00:57:10.028709 30232 raft_consensus.cc:2454] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161c8adb088846cfb3be19a5c8f6927d in term 1.
I20260806 00:57:10.028889 30329 leader_election.cc:302] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161c8adb088846cfb3be19a5c8f6927d, d463a7b2c10f42e0aebf0c0e4b1345de; no voters:
I20260806 00:57:10.028990 30697 raft_consensus.cc:2781] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:10.029160 30697 raft_consensus.cc:686] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [term 1 LEADER]: Becoming Leader. State: Replica: 161c8adb088846cfb3be19a5c8f6927d, State: Running, Role: LEADER
I20260806 00:57:10.029265 30697 consensus_queue.cc:237] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d463a7b2c10f42e0aebf0c0e4b1345de" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44521 } } peers { permanent_uuid: "b243c2505aaf430a929ba79984fae366" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38451 } } peers { permanent_uuid: "161c8adb088846cfb3be19a5c8f6927d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42413 } }
I20260806 00:57:10.030115 30038 catalog_manager.cc:5495] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d reported cstate change: term changed from 0 to 1, leader changed from <none> to 161c8adb088846cfb3be19a5c8f6927d (127.3.98.130). New cstate: current_term: 1 leader_uuid: "161c8adb088846cfb3be19a5c8f6927d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d463a7b2c10f42e0aebf0c0e4b1345de" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b243c2505aaf430a929ba79984fae366" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161c8adb088846cfb3be19a5c8f6927d" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 42413 } health_report { overall_health: HEALTHY } } }
I20260806 00:57:10.038524 30682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.036214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52422 (local address 127.3.98.130:42413)
0806 00:57:10.036270 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.036272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.036280 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:57:10.036345 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.036346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.036362 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.036422 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:10.036599 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.037044 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.037813 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.037990 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.038046 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.038178 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:10.038270 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:10.038331 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.038363 (+ 32us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.038380 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 00:57:10.040269 30600 raft_consensus.cc:1261] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366 [term 1 FOLLOWER]: Refusing update from remote peer 161c8adb088846cfb3be19a5c8f6927d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:10.040278 30232 raft_consensus.cc:1261] T 441a39797a6a405e9f9d9cb429e4905f P d463a7b2c10f42e0aebf0c0e4b1345de [term 1 FOLLOWER]: Refusing update from remote peer 161c8adb088846cfb3be19a5c8f6927d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:10.040661 30699 consensus_queue.cc:1035] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b243c2505aaf430a929ba79984fae366" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 38451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:10.040798 30697 consensus_queue.cc:1035] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d463a7b2c10f42e0aebf0c0e4b1345de" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 44521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:10.043452 30703 mvcc.cc:205] Tried to move back new op lower bound from 7315365191842074624 to 7315365191800504320. Current Snapshot: MvccSnapshot[applied={T|T < 7315365191842074624}]
I20260806 00:57:10.043763 30705 mvcc.cc:205] Tried to move back new op lower bound from 7315365191842074624 to 7315365191800504320. Current Snapshot: MvccSnapshot[applied={T|T < 7315365191842074624}]
I20260806 00:57:10.045305 30038 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:57:10.045421 30038 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:57:10.046160 30038 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 50ca11fccbed411abf70cd6fc67a4653: Sending DeleteTablet for 3 replicas of tablet 441a39797a6a405e9f9d9cb429e4905f
I20260806 00:57:10.046528 30569 tablet_service.cc:1514] Processing DeleteTablet for tablet 441a39797a6a405e9f9d9cb429e4905f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:10 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:59572
I20260806 00:57:10.046602 30395 tablet_service.cc:1514] Processing DeleteTablet for tablet 441a39797a6a405e9f9d9cb429e4905f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:10 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:52406
I20260806 00:57:10.046790 30713 tablet_replica.cc:330] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366: stopping tablet replica
I20260806 00:57:10.046792 30716 tablet_replica.cc:330] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d: stopping tablet replica
I20260806 00:57:10.046792 30206 tablet_service.cc:1514] Processing DeleteTablet for tablet 441a39797a6a405e9f9d9cb429e4905f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:10 UTC) from {username='kudu', principal='kudu/127.3.98.190@KRBTEST.COM'} at 127.0.0.1:40108
I20260806 00:57:10.046900 30716 raft_consensus.cc:2229] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:57:10.046990 30713 raft_consensus.cc:2229] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:57:10.047035 30716 raft_consensus.cc:2258] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:57:10.047055 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 30121
I20260806 00:57:10.049578 30713 raft_consensus.cc:2258] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:57:10.051396 30713 ts_tablet_manager.cc:1905] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:57:10.053704 30713 ts_tablet_manager.cc:1918] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:57:10.053788 30713 log.cc:1196] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/441a39797a6a405e9f9d9cb429e4905f
I20260806 00:57:10.053829 30716 ts_tablet_manager.cc:1905] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:57:10.054126 30713 ts_tablet_manager.cc:1939] T 441a39797a6a405e9f9d9cb429e4905f P b243c2505aaf430a929ba79984fae366: Deleting consensus metadata
I20260806 00:57:10.054585 30020 catalog_manager.cc:4841] TS b243c2505aaf430a929ba79984fae366 (127.3.98.131:38451): tablet 441a39797a6a405e9f9d9cb429e4905f (table test-table [id=4b6d700ed69f44afa8de1405e104797a]) successfully deleted
I20260806 00:57:10.055366 30716 ts_tablet_manager.cc:1918] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:57:10.055459 30716 log.cc:1196] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/441a39797a6a405e9f9d9cb429e4905f
I20260806 00:57:10.055732 30716 ts_tablet_manager.cc:1939] T 441a39797a6a405e9f9d9cb429e4905f P 161c8adb088846cfb3be19a5c8f6927d: Deleting consensus metadata
I20260806 00:57:10.056144 30020 catalog_manager.cc:4841] TS 161c8adb088846cfb3be19a5c8f6927d (127.3.98.130:42413): tablet 441a39797a6a405e9f9d9cb429e4905f (table test-table [id=4b6d700ed69f44afa8de1405e104797a]) successfully deleted
W20260806 00:57:10.060784 30021 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:44521 (error 108)
I20260806 00:57:10.061053 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 30306
I20260806 00:57:10.061823 30676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.061235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:44521 (local address 127.0.0.1:40110)
0806 00:57:10.061682 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:10.061783 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:44521: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423}
W20260806 00:57:10.061969 30021 catalog_manager.cc:4584] TS d463a7b2c10f42e0aebf0c0e4b1345de (127.3.98.129:44521): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 441a39797a6a405e9f9d9cb429e4905f: Network error: Client connection negotiation failed: client connection to 127.3.98.129:44521: connect: Connection refused (error 111)
I20260806 00:57:10.069118 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 30495
I20260806 00:57:10.079473 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 29998
2026-08-06T00:57:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2164 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T00:57:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:10Z Disabled control of system clock
I20260806 00:57:10.110934 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:33277
--webserver_interface=127.3.98.190
--webserver_port=0
--builtin_ntp_servers=127.3.98.148:36947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:33277
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 00:57:10.193863 30725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:10.194096 30725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:10.194118 30725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:10.195302 30725 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:10.195343 30725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:10.195355 30725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:10.195369 30725 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:10.195380 30725 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:10.196727 30725 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:33277
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:33277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:10.196925 30725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:10.197173 30725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:10.201977 30734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:10.202112 30725 server_base.cc:1034] running on GCE node
W20260806 00:57:10.202034 30736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:10.201972 30732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:10.202579 30725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:10.202946 30725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:10.204114 30725 hybrid_clock.cc:648] HybridClock initialized: now 1785977830204162 us; error 91 us; skew 500 ppm
I20260806 00:57:10.205519 30725 webserver.cc:460] Webserver started at http://127.3.98.190:44751/ using document root <none> and password file <none>
I20260806 00:57:10.205806 30725 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:10.205880 30725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:10.206035 30725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:10.207129 30725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "56228f245c7b43b99757234b4dd69dd8"
format_stamp: "Formatted at 2026-08-06 00:57:10 on dist-test-slave-44d2"
server_key: "39a7de2d63852ff1ac8904bafdc25b79"
server_key_iv: "cf7ff689e693a00e21a14d2f39fa7b5e"
server_key_version: "encryptionkey@0"
I20260806 00:57:10.207499 30725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "56228f245c7b43b99757234b4dd69dd8"
format_stamp: "Formatted at 2026-08-06 00:57:10 on dist-test-slave-44d2"
server_key: "39a7de2d63852ff1ac8904bafdc25b79"
server_key_iv: "cf7ff689e693a00e21a14d2f39fa7b5e"
server_key_version: "encryptionkey@0"
I20260806 00:57:10.208906 30725 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:10.209627 30744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:10.209807 30725 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:10.209918 30725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "56228f245c7b43b99757234b4dd69dd8"
format_stamp: "Formatted at 2026-08-06 00:57:10 on dist-test-slave-44d2"
server_key: "39a7de2d63852ff1ac8904bafdc25b79"
server_key_iv: "cf7ff689e693a00e21a14d2f39fa7b5e"
server_key_version: "encryptionkey@0"
I20260806 00:57:10.209993 30725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:10.227422 30725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:10.227746 30725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:10.227902 30725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:10.232010 30725 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:33277
I20260806 00:57:10.232076 30816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:33277 every 8 connection(s)
I20260806 00:57:10.232437 30725 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:10.233520 30818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:10.235587 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 30725
I20260806 00:57:10.235678 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:10.235891 3466 external_mini_cluster.cc:1428] Setting key 138df40749af05db86a32e90d7e87153
I20260806 00:57:10.236001 30818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8: Bootstrap starting.
I20260806 00:57:10.236737 30818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:10.237071 30818 log.cc:824] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:10.237794 30818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8: No bootstrap required, opened a new log
I20260806 00:57:10.239604 30818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56228f245c7b43b99757234b4dd69dd8" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 33277 } }
I20260806 00:57:10.239763 30818 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:10.239813 30818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56228f245c7b43b99757234b4dd69dd8, State: Initialized, Role: FOLLOWER
I20260806 00:57:10.239955 30818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56228f245c7b43b99757234b4dd69dd8" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 33277 } }
I20260806 00:57:10.240058 30818 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:10.240118 30818 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:10.240170 30818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:10.240810 30818 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56228f245c7b43b99757234b4dd69dd8" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 33277 } }
I20260806 00:57:10.240933 30818 leader_election.cc:302] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56228f245c7b43b99757234b4dd69dd8; no voters:
I20260806 00:57:10.241153 30818 leader_election.cc:288] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:10.241189 30825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:10.241297 30825 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [term 1 LEADER]: Becoming Leader. State: Replica: 56228f245c7b43b99757234b4dd69dd8, State: Running, Role: LEADER
I20260806 00:57:10.241462 30818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:10.241439 30825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56228f245c7b43b99757234b4dd69dd8" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 33277 } }
I20260806 00:57:10.241781 30828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56228f245c7b43b99757234b4dd69dd8. Latest consensus state: current_term: 1 leader_uuid: "56228f245c7b43b99757234b4dd69dd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56228f245c7b43b99757234b4dd69dd8" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 33277 } } }
I20260806 00:57:10.241878 30822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.236440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34370 (local address 127.3.98.190:33277)
0806 00:57:10.236731 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.236739 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.236764 (+ 25us) server_negotiation.cc:407] Connection header received
0806 00:57:10.237272 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.237280 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.237345 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.237491 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:10.237705 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.238665 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.239469 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.239969 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.240111 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.240949 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:10.240953 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:10.240953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:10.241180 (+ 227us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:10.241243 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:10.241259 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:10.241330 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.241579 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.241664 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":121,"threads_started":1}
I20260806 00:57:10.241947 30828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:10.242826 30837 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:10.243264 30826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56228f245c7b43b99757234b4dd69dd8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56228f245c7b43b99757234b4dd69dd8" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 33277 } } }
I20260806 00:57:10.243350 30837 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:10.243376 30826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:10.244949 30837 catalog_manager.cc:1347] Generated new cluster ID: cbf5ab8573264da39e49b225dc907f8e
I20260806 00:57:10.245002 30837 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:10.283725 30837 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:10.284291 30837 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:10.287869 30837 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8: Generated new TSK 0
I20260806 00:57:10.288069 30837 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:10.292893 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.129:0
--local_ip_for_outbound_sockets=127.3.98.129
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:33277
--builtin_ntp_servers=127.3.98.148:36947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 00:57:10.377338 30848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:10.377545 30848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:10.377568 30848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:10.378788 30848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:10.378834 30848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:10.378858 30848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.129
I20260806 00:57:10.380208 30848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.98.129
--webserver_port=0
--tserver_master_addrs=127.3.98.190:33277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.129
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:10.380465 30848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:10.380802 30848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:10.385911 30859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:10.385906 30865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:10.385964 30862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:10.386294 30848 server_base.cc:1034] running on GCE node
I20260806 00:57:10.386490 30848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:10.386708 30848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:10.387861 30848 hybrid_clock.cc:648] HybridClock initialized: now 1785977830387850 us; error 27 us; skew 500 ppm
I20260806 00:57:10.389276 30848 webserver.cc:460] Webserver started at http://127.3.98.129:38841/ using document root <none> and password file <none>
I20260806 00:57:10.389546 30848 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:10.389596 30848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:10.389770 30848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:10.390854 30848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/data/instance:
uuid: "c4508b6a25214e11bf459abd1f94ff71"
format_stamp: "Formatted at 2026-08-06 00:57:10 on dist-test-slave-44d2"
server_key: "c1c5c2237a458d9520098b4bbab3a2e4"
server_key_iv: "df0bfc285c660464467d3824b803cfd0"
server_key_version: "encryptionkey@0"
I20260806 00:57:10.391252 30848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance:
uuid: "c4508b6a25214e11bf459abd1f94ff71"
format_stamp: "Formatted at 2026-08-06 00:57:10 on dist-test-slave-44d2"
server_key: "c1c5c2237a458d9520098b4bbab3a2e4"
server_key_iv: "df0bfc285c660464467d3824b803cfd0"
server_key_version: "encryptionkey@0"
I20260806 00:57:10.393047 30848 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260806 00:57:10.394034 30873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:10.394228 30848 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:10.394320 30848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/wal
uuid: "c4508b6a25214e11bf459abd1f94ff71"
format_stamp: "Formatted at 2026-08-06 00:57:10 on dist-test-slave-44d2"
server_key: "c1c5c2237a458d9520098b4bbab3a2e4"
server_key_iv: "df0bfc285c660464467d3824b803cfd0"
server_key_version: "encryptionkey@0"
I20260806 00:57:10.394397 30848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:10.436309 30848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:10.436707 30848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:10.436833 30848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:10.437048 30848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:10.437433 30848 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:10.437470 30848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:10.437518 30848 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:10.437548 30848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:10.443548 30848 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.129:34745
I20260806 00:57:10.443643 31026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.129:34745 every 8 connection(s)
I20260806 00:57:10.443980 30848 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/data/info.pb
I20260806 00:57:10.449100 30822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.444786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.129:55153 (local address 127.3.98.190:33277)
0806 00:57:10.444861 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.444863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.445100 (+ 237us) server_negotiation.cc:407] Connection header received
0806 00:57:10.445593 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.445594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.445604 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.445660 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:10.446321 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.446820 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.447773 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.447955 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.448008 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.448818 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:10.448819 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:10.448819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:10.448824 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:10.448838 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:10.448842 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:10.448889 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.448957 (+ 68us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.448980 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 00:57:10.449265 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 30848
I20260806 00:57:10.449287 31029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.444758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:33277 (local address 127.3.98.129:55153)
0806 00:57:10.444960 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:10.445002 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:10.445490 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:10.445722 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:10.445725 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:10.445734 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:10.446249 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.446255 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.446908 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.446909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.447698 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.447700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.448035 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.448036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.448149 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.448685 (+ 536us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:57:10.448686 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:10.448713 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:57:10.448737 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:10.448893 (+ 156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:10.448895 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:10.448898 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:57:10.448945 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 00:57:10.449024 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":100,"threads_started":1}
I20260806 00:57:10.449386 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-0/wal/instance
I20260806 00:57:10.449627 3466 external_mini_cluster.cc:1428] Setting key ebefe809506fa7bf0a23a161909988ce
I20260806 00:57:10.449839 31027 heartbeater.cc:347] Connected to a master server at 127.3.98.190:33277
I20260806 00:57:10.449930 31027 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:10.450117 31027 heartbeater.cc:511] Master 127.3.98.190:33277 requested a full tablet report, sending...
I20260806 00:57:10.450630 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.130:0
--local_ip_for_outbound_sockets=127.3.98.130
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:33277
--builtin_ntp_servers=127.3.98.148:36947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 00:57:10.450637 30764 ts_manager.cc:194] Registered new tserver with Master: c4508b6a25214e11bf459abd1f94ff71 (127.3.98.129:34745)
I20260806 00:57:10.451288 30764 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.98.129:55153
W20260806 00:57:10.534332 31031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:10.534536 31031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:10.534559 31031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:10.535732 31031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:10.535775 31031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:10.535828 31031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.130
I20260806 00:57:10.537276 31031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.98.130
--webserver_port=0
--tserver_master_addrs=127.3.98.190:33277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.130
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:10.537529 31031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:10.537837 31031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:10.543115 31043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:10.543121 31039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:10.543215 31031 server_base.cc:1034] running on GCE node
W20260806 00:57:10.543124 31040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:10.543602 31031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:10.543874 31031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:10.545044 31031 hybrid_clock.cc:648] HybridClock initialized: now 1785977830545029 us; error 26 us; skew 500 ppm
I20260806 00:57:10.546280 31031 webserver.cc:460] Webserver started at http://127.3.98.130:41095/ using document root <none> and password file <none>
I20260806 00:57:10.546538 31031 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:10.546610 31031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:10.546768 31031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:10.547845 31031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/data/instance:
uuid: "12ccc553a886412ebffc1e44f871369c"
format_stamp: "Formatted at 2026-08-06 00:57:10 on dist-test-slave-44d2"
server_key: "3814d8bae03bafe09437456f660af5aa"
server_key_iv: "04153c8c88d009f9e5b9abce018d5a9a"
server_key_version: "encryptionkey@0"
I20260806 00:57:10.548230 31031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance:
uuid: "12ccc553a886412ebffc1e44f871369c"
format_stamp: "Formatted at 2026-08-06 00:57:10 on dist-test-slave-44d2"
server_key: "3814d8bae03bafe09437456f660af5aa"
server_key_iv: "04153c8c88d009f9e5b9abce018d5a9a"
server_key_version: "encryptionkey@0"
I20260806 00:57:10.549623 31031 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:10.550354 31050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:10.550580 31031 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:10.550685 31031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/wal
uuid: "12ccc553a886412ebffc1e44f871369c"
format_stamp: "Formatted at 2026-08-06 00:57:10 on dist-test-slave-44d2"
server_key: "3814d8bae03bafe09437456f660af5aa"
server_key_iv: "04153c8c88d009f9e5b9abce018d5a9a"
server_key_version: "encryptionkey@0"
I20260806 00:57:10.550760 31031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:10.565507 31031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:10.565824 31031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:10.565982 31031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:10.566226 31031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:10.566572 31031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:10.566649 31031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:10.566694 31031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:10.566722 31031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:10.572755 31031 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.130:38993
I20260806 00:57:10.572854 31201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.130:38993 every 8 connection(s)
I20260806 00:57:10.573194 31031 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/data/info.pb
I20260806 00:57:10.576270 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 31031
I20260806 00:57:10.576395 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/wal/instance
I20260806 00:57:10.576623 3466 external_mini_cluster.cc:1428] Setting key 123ef290ca1185cabe1d6f454c20df80
I20260806 00:57:10.577649 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.98.131:0
--local_ip_for_outbound_sockets=127.3.98.131
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:33277
--builtin_ntp_servers=127.3.98.148:36947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 00:57:10.579039 30822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.573981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.130:53099 (local address 127.3.98.190:33277)
0806 00:57:10.574051 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.574053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.574305 (+ 252us) server_negotiation.cc:407] Connection header received
0806 00:57:10.574845 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.574847 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.574863 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.574958 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:10.575650 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.576152 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.577527 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.577805 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.577881 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.578778 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:10.578780 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:10.578780 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:10.578785 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:10.578801 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:10.578806 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:10.578854 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.578927 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.578957 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 00:57:10.579317 31206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.573968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:33277 (local address 127.3.98.130:53099)
0806 00:57:10.574170 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:10.574212 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:10.574711 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:10.575010 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:10.575013 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:10.575022 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:10.575547 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.575551 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.576271 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.576273 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.577433 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.577437 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.577893 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.577894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.578049 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.578636 (+ 587us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:57:10.578636 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:10.578665 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:57:10.578688 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:10.578854 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:10.578860 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:10.578863 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:57:10.578931 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 00:57:10.579049 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":102,"threads_started":1}
I20260806 00:57:10.579975 31203 heartbeater.cc:347] Connected to a master server at 127.3.98.190:33277
I20260806 00:57:10.580097 31203 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:10.580286 31203 heartbeater.cc:511] Master 127.3.98.190:33277 requested a full tablet report, sending...
I20260806 00:57:10.580718 30764 ts_manager.cc:194] Registered new tserver with Master: 12ccc553a886412ebffc1e44f871369c (127.3.98.130:38993)
I20260806 00:57:10.581094 30764 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.98.130:53099
W20260806 00:57:10.669731 31207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:10.669929 31207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:10.669957 31207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:10.671088 31207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:10.671128 31207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:10.671208 31207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.98.131
I20260806 00:57:10.672644 31207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.98.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.98.131
--webserver_port=0
--tserver_master_addrs=127.3.98.190:33277
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.98.131
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:10.672887 31207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:10.673189 31207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:10.678504 31218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:10.678541 31215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:10.678545 31216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:10.678562 31207 server_base.cc:1034] running on GCE node
I20260806 00:57:10.678900 31207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:10.679103 31207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:10.680292 31207 hybrid_clock.cc:648] HybridClock initialized: now 1785977830680269 us; error 45 us; skew 500 ppm
I20260806 00:57:10.681598 31207 webserver.cc:460] Webserver started at http://127.3.98.131:43293/ using document root <none> and password file <none>
I20260806 00:57:10.681855 31207 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:10.681926 31207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:10.682107 31207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:10.683182 31207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/data/instance:
uuid: "13688fcd19b3498c827c33ace35b36ce"
format_stamp: "Formatted at 2026-08-06 00:57:10 on dist-test-slave-44d2"
server_key: "f3eb844020c829aa6420cc23f9ffa314"
server_key_iv: "4a1e9aba24ab1642167620401a640c9b"
server_key_version: "encryptionkey@0"
I20260806 00:57:10.683564 31207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance:
uuid: "13688fcd19b3498c827c33ace35b36ce"
format_stamp: "Formatted at 2026-08-06 00:57:10 on dist-test-slave-44d2"
server_key: "f3eb844020c829aa6420cc23f9ffa314"
server_key_iv: "4a1e9aba24ab1642167620401a640c9b"
server_key_version: "encryptionkey@0"
I20260806 00:57:10.685228 31207 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:10.686117 31226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:10.686307 31207 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:10.686415 31207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/wal
uuid: "13688fcd19b3498c827c33ace35b36ce"
format_stamp: "Formatted at 2026-08-06 00:57:10 on dist-test-slave-44d2"
server_key: "f3eb844020c829aa6420cc23f9ffa314"
server_key_iv: "4a1e9aba24ab1642167620401a640c9b"
server_key_version: "encryptionkey@0"
I20260806 00:57:10.686499 31207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:10.699035 31207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:10.699338 31207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:10.699491 31207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:10.699743 31207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 00:57:10.700094 31207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 00:57:10.700150 31207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:10.700186 31207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 00:57:10.700214 31207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:10.706290 31207 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.131:42263
I20260806 00:57:10.706329 31377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.131:42263 every 8 connection(s)
I20260806 00:57:10.706672 31207 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/data/info.pb
I20260806 00:57:10.711934 30822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.707469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:47415 (local address 127.3.98.190:33277)
0806 00:57:10.707538 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.707540 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.707763 (+ 223us) server_negotiation.cc:407] Connection header received
0806 00:57:10.708226 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.708227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.708238 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.708297 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:10.709004 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.709489 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.710654 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.710832 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.710885 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.711684 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:10.711686 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:10.711686 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:10.711690 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:10.711704 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:10.711708 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:10.711751 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.711850 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.711872 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 00:57:10.712159 31380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.707450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:33277 (local address 127.3.98.131:47415)
0806 00:57:10.707635 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:10.707675 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:10.708143 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:10.708348 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:10.708351 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:10.708360 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:10.708921 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.708926 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.709631 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.709633 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.710569 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.710572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.710923 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.710925 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.711048 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.711550 (+ 502us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 00:57:10.711551 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:10.711578 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 00:57:10.711600 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:10.711766 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:10.711771 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:10.711773 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 00:57:10.711827 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 00:57:10.711905 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260806 00:57:10.712714 31378 heartbeater.cc:347] Connected to a master server at 127.3.98.190:33277
I20260806 00:57:10.712821 31378 heartbeater.cc:464] Registering TS with master...
I20260806 00:57:10.713022 31378 heartbeater.cc:511] Master 127.3.98.190:33277 requested a full tablet report, sending...
I20260806 00:57:10.713421 30764 ts_manager.cc:194] Registered new tserver with Master: 13688fcd19b3498c827c33ace35b36ce (127.3.98.131:42263)
I20260806 00:57:10.713828 30764 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.98.131:47415
I20260806 00:57:10.714380 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 31207
I20260806 00:57:10.714493 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/wal/instance
I20260806 00:57:10.714700 3466 external_mini_cluster.cc:1428] Setting key d9c1ae6a0ae203804e0ae609d3d5893e
I20260806 00:57:10.715552 3466 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 00:57:10.719899 30822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.716950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34376 (local address 127.3.98.190:33277)
0806 00:57:10.717023 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.717026 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.717135 (+ 109us) server_negotiation.cc:407] Connection header received
0806 00:57:10.717217 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.717218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.717229 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.717280 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:10.717441 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.717905 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.718692 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.718897 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.718975 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.719667 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:10.719668 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:10.719669 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:10.719673 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:10.719686 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:10.719690 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:10.719744 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.719803 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.719822 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 00:57:10.721315 30764 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34376:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 00:57:10.722877 30764 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 00:57:10.729178 31391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.724960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:34745 (local address 127.0.0.1:44722)
0806 00:57:10.725120 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:10.725157 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:10.725222 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:10.725699 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:10.725700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:10.725702 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:10.725735 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.725736 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.727040 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.727041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.728070 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.728073 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.728897 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.728898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.728978 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.728993 (+ 15us) client_negotiation.cc:769] Sending connection context
0806 00:57:10.729040 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 00:57:10.729102 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":2,"thread_start_us":93,"threads_started":1}
I20260806 00:57:10.729422 31392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.725005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:38993 (local address 127.0.0.1:58098)
0806 00:57:10.725687 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:10.725699 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:10.725775 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:10.726143 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:10.726144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:10.726146 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:10.726216 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.726218 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.727079 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.727080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.728373 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.728376 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.729205 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.729206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.729267 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.729271 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 00:57:10.729311 (+ 40us) client_negotiation.cc:240] Negotiation successful
0806 00:57:10.729348 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"mutex_wait_us":84,"thread_start_us":81,"threads_started":1}
I20260806 00:57:10.729643 31395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.725496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58098 (local address 127.3.98.130:38993)
0806 00:57:10.725898 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.725902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.725912 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:57:10.725951 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.725953 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.725971 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.726054 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:10.726296 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.726963 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.728530 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.729105 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.729191 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.729282 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.729443 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.729485 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":89,"threads_started":1}
I20260806 00:57:10.729651 31394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.725268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44722 (local address 127.3.98.129:34745)
0806 00:57:10.725463 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.725470 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.725486 (+ 16us) server_negotiation.cc:407] Connection header received
0806 00:57:10.725519 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.725520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.725532 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.725632 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:10.725815 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.726927 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.728151 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.728793 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.729397 (+ 604us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.729483 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.729511 (+ 28us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.729559 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":109,"threads_started":1}
I20260806 00:57:10.729830 31390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.724970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.131:42263 (local address 127.0.0.1:35800)
0806 00:57:10.725319 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:10.725330 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:10.725369 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:10.725608 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:10.725611 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:10.725613 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:10.725691 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.725715 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.727045 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.727046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.728373 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.728376 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.729599 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.729600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.729661 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.729666 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:57:10.729718 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 00:57:10.729762 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"mutex_wait_us":94,"thread_start_us":87,"threads_started":1}
I20260806 00:57:10.730108 31393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.725230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35800 (local address 127.3.98.131:42263)
0806 00:57:10.725413 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.725418 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.725430 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:57:10.725467 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.725469 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.725484 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.725585 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:10.725805 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.726956 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.728465 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.729209 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.729389 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.729577 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.729990 (+ 413us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.730030 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":95,"threads_started":1}
I20260806 00:57:10.730528 31115 tablet_service.cc:1467] Processing CreateTablet for tablet 96d34ae003554725892a13f4725762ef (DEFAULT_TABLE table=test-table [id=96e2c969718044fea09e834a32064e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:10.730535 30939 tablet_service.cc:1467] Processing CreateTablet for tablet 96d34ae003554725892a13f4725762ef (DEFAULT_TABLE table=test-table [id=96e2c969718044fea09e834a32064e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:10.730703 31291 tablet_service.cc:1467] Processing CreateTablet for tablet 96d34ae003554725892a13f4725762ef (DEFAULT_TABLE table=test-table [id=96e2c969718044fea09e834a32064e17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 00:57:10.730816 31115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96d34ae003554725892a13f4725762ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:10.730890 30939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96d34ae003554725892a13f4725762ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:10.730988 31291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96d34ae003554725892a13f4725762ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:10.733441 31396 tablet_bootstrap.cc:492] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c: Bootstrap starting.
I20260806 00:57:10.734087 31396 tablet_bootstrap.cc:654] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:10.734433 31396 log.cc:824] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:10.734450 31398 tablet_bootstrap.cc:492] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71: Bootstrap starting.
I20260806 00:57:10.735085 31398 tablet_bootstrap.cc:654] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:10.735244 31396 tablet_bootstrap.cc:492] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c: No bootstrap required, opened a new log
I20260806 00:57:10.735317 31396 ts_tablet_manager.cc:1397] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 00:57:10.735431 31398 log.cc:824] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:10.735718 31397 tablet_bootstrap.cc:492] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce: Bootstrap starting.
I20260806 00:57:10.736436 31397 tablet_bootstrap.cc:654] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:10.736778 31397 log.cc:824] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:10.737349 31398 tablet_bootstrap.cc:492] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71: No bootstrap required, opened a new log
I20260806 00:57:10.737425 31398 ts_tablet_manager.cc:1397] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 00:57:10.737475 31397 tablet_bootstrap.cc:492] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce: No bootstrap required, opened a new log
I20260806 00:57:10.737546 31397 ts_tablet_manager.cc:1397] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260806 00:57:10.738322 31396 raft_consensus.cc:348] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4508b6a25214e11bf459abd1f94ff71" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34745 } } peers { permanent_uuid: "13688fcd19b3498c827c33ace35b36ce" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42263 } } peers { permanent_uuid: "12ccc553a886412ebffc1e44f871369c" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38993 } }
I20260806 00:57:10.738502 31396 raft_consensus.cc:374] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:10.738557 31396 raft_consensus.cc:729] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12ccc553a886412ebffc1e44f871369c, State: Initialized, Role: FOLLOWER
I20260806 00:57:10.738698 31396 consensus_queue.cc:260] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4508b6a25214e11bf459abd1f94ff71" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34745 } } peers { permanent_uuid: "13688fcd19b3498c827c33ace35b36ce" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42263 } } peers { permanent_uuid: "12ccc553a886412ebffc1e44f871369c" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38993 } }
I20260806 00:57:10.738957 31396 ts_tablet_manager.cc:1428] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 00:57:10.739074 31203 heartbeater.cc:503] Master 127.3.98.190:33277 was elected leader, sending a full tablet report...
I20260806 00:57:10.739887 31398 raft_consensus.cc:348] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4508b6a25214e11bf459abd1f94ff71" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34745 } } peers { permanent_uuid: "13688fcd19b3498c827c33ace35b36ce" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42263 } } peers { permanent_uuid: "12ccc553a886412ebffc1e44f871369c" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38993 } }
I20260806 00:57:10.740046 31398 raft_consensus.cc:374] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:10.739966 31397 raft_consensus.cc:348] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4508b6a25214e11bf459abd1f94ff71" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34745 } } peers { permanent_uuid: "13688fcd19b3498c827c33ace35b36ce" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42263 } } peers { permanent_uuid: "12ccc553a886412ebffc1e44f871369c" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38993 } }
I20260806 00:57:10.740099 31398 raft_consensus.cc:729] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4508b6a25214e11bf459abd1f94ff71, State: Initialized, Role: FOLLOWER
I20260806 00:57:10.740114 31397 raft_consensus.cc:374] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:10.740151 31397 raft_consensus.cc:729] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13688fcd19b3498c827c33ace35b36ce, State: Initialized, Role: FOLLOWER
I20260806 00:57:10.740216 31398 consensus_queue.cc:260] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4508b6a25214e11bf459abd1f94ff71" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34745 } } peers { permanent_uuid: "13688fcd19b3498c827c33ace35b36ce" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42263 } } peers { permanent_uuid: "12ccc553a886412ebffc1e44f871369c" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38993 } }
I20260806 00:57:10.740283 31397 consensus_queue.cc:260] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4508b6a25214e11bf459abd1f94ff71" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34745 } } peers { permanent_uuid: "13688fcd19b3498c827c33ace35b36ce" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42263 } } peers { permanent_uuid: "12ccc553a886412ebffc1e44f871369c" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38993 } }
I20260806 00:57:10.740557 31397 ts_tablet_manager.cc:1428] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 00:57:10.740578 31027 heartbeater.cc:503] Master 127.3.98.190:33277 was elected leader, sending a full tablet report...
I20260806 00:57:10.740650 31378 heartbeater.cc:503] Master 127.3.98.190:33277 was elected leader, sending a full tablet report...
I20260806 00:57:10.740537 31398 ts_tablet_manager.cc:1428] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260806 00:57:10.793756 31405 raft_consensus.cc:482] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 00:57:10.793887 31405 raft_consensus.cc:504] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4508b6a25214e11bf459abd1f94ff71" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34745 } } peers { permanent_uuid: "13688fcd19b3498c827c33ace35b36ce" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42263 } } peers { permanent_uuid: "12ccc553a886412ebffc1e44f871369c" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38993 } }
I20260806 00:57:10.794250 31405 leader_election.cc:288] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4508b6a25214e11bf459abd1f94ff71 (127.3.98.129:34745), 12ccc553a886412ebffc1e44f871369c (127.3.98.130:38993)
I20260806 00:57:10.797051 31395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.794542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:53891 (local address 127.3.98.130:38993)
0806 00:57:10.794606 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.794608 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.794616 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:57:10.794654 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.794654 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.794662 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.794728 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:10.794884 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.795359 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.796293 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.796715 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.796795 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.796803 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.796945 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.796980 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 00:57:10.797051 31380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.794424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.130:38993 (local address 127.3.98.131:53891)
0806 00:57:10.794488 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:10.794501 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:10.794553 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:10.794735 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:10.794736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:10.794738 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:10.794812 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.794813 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.795444 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.795445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.796195 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.796198 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.796804 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.796805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.796872 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.796875 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 00:57:10.796937 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 00:57:10.796978 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 00:57:10.797339 31394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.794577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.98.131:39721 (local address 127.3.98.129:34745)
0806 00:57:10.794625 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.794628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.794728 (+ 100us) server_negotiation.cc:407] Connection header received
0806 00:57:10.794802 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.794803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.794815 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.794889 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 00:57:10.795067 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.795532 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.796459 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.796942 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.797028 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.797035 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.797230 (+ 195us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.797275 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 00:57:10.797467 31144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96d34ae003554725892a13f4725762ef" candidate_uuid: "13688fcd19b3498c827c33ace35b36ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12ccc553a886412ebffc1e44f871369c" is_pre_election: true
I20260806 00:57:10.797566 31406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.794460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:34745 (local address 127.3.98.131:39721)
0806 00:57:10.794649 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:10.794659 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:10.794745 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:10.794893 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:10.794894 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:10.794895 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 00:57:10.794974 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.794975 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.795622 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.795623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.796363 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:10.796365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.797032 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.797033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:10.797126 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.797131 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 00:57:10.797445 (+ 314us) client_negotiation.cc:240] Negotiation successful
0806 00:57:10.797488 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":101,"threads_started":1}
I20260806 00:57:10.797654 31144 raft_consensus.cc:2454] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13688fcd19b3498c827c33ace35b36ce in term 0.
I20260806 00:57:10.797878 30965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96d34ae003554725892a13f4725762ef" candidate_uuid: "13688fcd19b3498c827c33ace35b36ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4508b6a25214e11bf459abd1f94ff71" is_pre_election: true
I20260806 00:57:10.797928 31228 leader_election.cc:302] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ccc553a886412ebffc1e44f871369c, 13688fcd19b3498c827c33ace35b36ce; no voters:
I20260806 00:57:10.798038 30965 raft_consensus.cc:2454] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13688fcd19b3498c827c33ace35b36ce in term 0.
I20260806 00:57:10.798061 31405 raft_consensus.cc:2781] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 00:57:10.798105 31405 raft_consensus.cc:482] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 00:57:10.798138 31405 raft_consensus.cc:3037] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:10.799086 31405 raft_consensus.cc:504] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4508b6a25214e11bf459abd1f94ff71" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34745 } } peers { permanent_uuid: "13688fcd19b3498c827c33ace35b36ce" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42263 } } peers { permanent_uuid: "12ccc553a886412ebffc1e44f871369c" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38993 } }
I20260806 00:57:10.799224 31405 leader_election.cc:288] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [CANDIDATE]: Term 1 election: Requested vote from peers c4508b6a25214e11bf459abd1f94ff71 (127.3.98.129:34745), 12ccc553a886412ebffc1e44f871369c (127.3.98.130:38993)
I20260806 00:57:10.799350 30965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96d34ae003554725892a13f4725762ef" candidate_uuid: "13688fcd19b3498c827c33ace35b36ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4508b6a25214e11bf459abd1f94ff71"
I20260806 00:57:10.799366 31144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96d34ae003554725892a13f4725762ef" candidate_uuid: "13688fcd19b3498c827c33ace35b36ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12ccc553a886412ebffc1e44f871369c"
I20260806 00:57:10.799443 30965 raft_consensus.cc:3037] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:10.799446 31144 raft_consensus.cc:3037] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:10.800205 31144 raft_consensus.cc:2454] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13688fcd19b3498c827c33ace35b36ce in term 1.
I20260806 00:57:10.800209 30965 raft_consensus.cc:2454] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13688fcd19b3498c827c33ace35b36ce in term 1.
I20260806 00:57:10.800371 31228 leader_election.cc:302] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12ccc553a886412ebffc1e44f871369c, 13688fcd19b3498c827c33ace35b36ce; no voters:
I20260806 00:57:10.800504 31405 raft_consensus.cc:2781] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:10.800640 31405 raft_consensus.cc:686] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [term 1 LEADER]: Becoming Leader. State: Replica: 13688fcd19b3498c827c33ace35b36ce, State: Running, Role: LEADER
I20260806 00:57:10.800737 31405 consensus_queue.cc:237] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4508b6a25214e11bf459abd1f94ff71" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34745 } } peers { permanent_uuid: "13688fcd19b3498c827c33ace35b36ce" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42263 } } peers { permanent_uuid: "12ccc553a886412ebffc1e44f871369c" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38993 } }
I20260806 00:57:10.801584 30764 catalog_manager.cc:5495] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 13688fcd19b3498c827c33ace35b36ce (127.3.98.131). New cstate: current_term: 1 leader_uuid: "13688fcd19b3498c827c33ace35b36ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4508b6a25214e11bf459abd1f94ff71" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13688fcd19b3498c827c33ace35b36ce" member_type: VOTER last_known_addr { host: "127.3.98.131" port: 42263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12ccc553a886412ebffc1e44f871369c" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38993 } health_report { overall_health: UNKNOWN } } }
I20260806 00:57:10.821657 31393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.819370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35808 (local address 127.3.98.131:42263)
0806 00:57:10.819418 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:10.819420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:10.819427 (+ 7us) server_negotiation.cc:407] Connection header received
0806 00:57:10.819489 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:10.819490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:10.819508 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:10.819575 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:10.819688 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.820138 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.820901 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:10.821106 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:10.821161 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:10.821312 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:10.821415 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:10.821478 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:10.821497 (+ 19us) server_negotiation.cc:299] Negotiation successful
0806 00:57:10.821528 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 00:57:10.823622 31144 raft_consensus.cc:1261] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c [term 1 FOLLOWER]: Refusing update from remote peer 13688fcd19b3498c827c33ace35b36ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:10.823668 30965 raft_consensus.cc:1261] T 96d34ae003554725892a13f4725762ef P c4508b6a25214e11bf459abd1f94ff71 [term 1 FOLLOWER]: Refusing update from remote peer 13688fcd19b3498c827c33ace35b36ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260806 00:57:10.823736 31204 tablet.cc:2369] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 00:57:10.824054 31405 consensus_queue.cc:1035] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4508b6a25214e11bf459abd1f94ff71" member_type: VOTER last_known_addr { host: "127.3.98.129" port: 34745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:10.824204 31407 consensus_queue.cc:1035] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "12ccc553a886412ebffc1e44f871369c" member_type: VOTER last_known_addr { host: "127.3.98.130" port: 38993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:10.826586 31410 mvcc.cc:205] Tried to move back new op lower bound from 7315365195050573824 to 7315365194960592896. Current Snapshot: MvccSnapshot[applied={T|T < 7315365195050573824}]
I20260806 00:57:10.826754 31411 mvcc.cc:205] Tried to move back new op lower bound from 7315365195050573824 to 7315365194960592896. Current Snapshot: MvccSnapshot[applied={T|T < 7315365195050573824}]
I20260806 00:57:10.827108 31412 mvcc.cc:205] Tried to move back new op lower bound from 7315365195050573824 to 7315365194960592896. Current Snapshot: MvccSnapshot[applied={T|T < 7315365195050573824}]
I20260806 00:57:10.829030 30764 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:57:10.829133 30764 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 00:57:10.829921 30764 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 56228f245c7b43b99757234b4dd69dd8: Sending DeleteTablet for 3 replicas of tablet 96d34ae003554725892a13f4725762ef
I20260806 00:57:10.830263 30939 tablet_service.cc:1514] Processing DeleteTablet for tablet 96d34ae003554725892a13f4725762ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:10 UTC) from {username='slave'} at 127.0.0.1:44722
I20260806 00:57:10.830264 31291 tablet_service.cc:1514] Processing DeleteTablet for tablet 96d34ae003554725892a13f4725762ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:10 UTC) from {username='slave'} at 127.0.0.1:35800
I20260806 00:57:10.830402 31115 tablet_service.cc:1514] Processing DeleteTablet for tablet 96d34ae003554725892a13f4725762ef with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 00:57:10 UTC) from {username='slave'} at 127.0.0.1:58098
I20260806 00:57:10.830541 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 30848
I20260806 00:57:10.837381 31425 tablet_replica.cc:330] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c: stopping tablet replica
I20260806 00:57:10.837565 31425 raft_consensus.cc:2229] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 00:57:10.837761 31425 raft_consensus.cc:2258] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:57:10.838209 31425 ts_tablet_manager.cc:1905] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:57:10.839589 31421 tablet_replica.cc:330] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce: stopping tablet replica
I20260806 00:57:10.839717 31421 raft_consensus.cc:2229] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [term 1 LEADER]: Raft consensus shutting down.
I20260806 00:57:10.839818 31425 ts_tablet_manager.cc:1918] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:57:10.839849 31421 raft_consensus.cc:2258] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 00:57:10.839910 31425 log.cc:1196] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-1/wal/wals/96d34ae003554725892a13f4725762ef
I20260806 00:57:10.840229 31421 ts_tablet_manager.cc:1905] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 00:57:10.840337 31425 ts_tablet_manager.cc:1939] T 96d34ae003554725892a13f4725762ef P 12ccc553a886412ebffc1e44f871369c: Deleting consensus metadata
I20260806 00:57:10.840865 30746 catalog_manager.cc:4841] TS 12ccc553a886412ebffc1e44f871369c (127.3.98.130:38993): tablet 96d34ae003554725892a13f4725762ef (table test-table [id=96e2c969718044fea09e834a32064e17]) successfully deleted
I20260806 00:57:10.842315 31421 ts_tablet_manager.cc:1918] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 00:57:10.842393 31421 log.cc:1196] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce: Deleting WAL directory at /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785977579314977-3466-0/minicluster-data/ts-2/wal/wals/96d34ae003554725892a13f4725762ef
W20260806 00:57:10.842852 30747 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.98.129:34745 (error 108)
I20260806 00:57:10.843060 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 31031
I20260806 00:57:10.843137 31421 ts_tablet_manager.cc:1939] T 96d34ae003554725892a13f4725762ef P 13688fcd19b3498c827c33ace35b36ce: Deleting consensus metadata
I20260806 00:57:10.850234 30748 catalog_manager.cc:4841] TS 13688fcd19b3498c827c33ace35b36ce (127.3.98.131:42263): tablet 96d34ae003554725892a13f4725762ef (table test-table [id=96e2c969718044fea09e834a32064e17]) successfully deleted
I20260806 00:57:10.850438 31390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:10.850211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.129:34745 (local address 127.0.0.1:44732)
0806 00:57:10.850360 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:10.850407 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.129:34745: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260806 00:57:10.850594 30747 catalog_manager.cc:4584] TS c4508b6a25214e11bf459abd1f94ff71 (127.3.98.129:34745): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 96d34ae003554725892a13f4725762ef: Network error: Client connection negotiation failed: client connection to 127.3.98.129:34745: connect: Connection refused (error 111)
I20260806 00:57:10.861433 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 31207
I20260806 00:57:10.872417 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 30725
2026-08-06T00:57:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (797 ms)
[----------] 6 tests from EncryptionPolicyTest (9429 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:10 dist-test-slave-44d2 krb5kdc[31430](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:10 dist-test-slave-44d2 krb5kdc[31430](info): set up 2 sockets
Aug 06 00:57:10 dist-test-slave-44d2 krb5kdc[31430](info): commencing operation
krb5kdc: starting...
W20260806 00:57:12.092242 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:12 dist-test-slave-44d2 krb5kdc[31430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 00:57:12.217281 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38365
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:12.301072 31451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:12.301287 31451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:12.301311 31451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:12.302457 31451 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:12.302503 31451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:12.302518 31451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:12.302532 31451 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:12.302544 31451 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:12.304020 31451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38365
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:12.304282 31451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:12.304544 31451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:12.309476 31457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:12.309473 31458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:12.309509 31465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:12.309900 31451 server_base.cc:1034] running on GCE node
I20260806 00:57:12.310124 31451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:12.310386 31451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:12.311551 31451 hybrid_clock.cc:648] HybridClock initialized: now 1785977832311550 us; error 46 us; skew 500 ppm
Aug 06 00:57:12 dist-test-slave-44d2 krb5kdc[31430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977832, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:12.318059 31451 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 00:57:12.318544 31451 webserver.cc:460] Webserver started at http://127.0.0.1:33609/ using document root <none> and password file <none>
I20260806 00:57:12.318806 31451 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:12.318854 31451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:12.319034 31451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:12.320192 31451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "6317a0928b2649f0bf8039a4d2acfd85"
format_stamp: "Formatted at 2026-08-06 00:57:12 on dist-test-slave-44d2"
server_key: "94d41c92cda6c6dafbb2ff84e59e8a12"
server_key_iv: "5afc162c1f242438262e8c674abfa404"
server_key_version: "encryptionkey@0"
I20260806 00:57:12.320617 31451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "6317a0928b2649f0bf8039a4d2acfd85"
format_stamp: "Formatted at 2026-08-06 00:57:12 on dist-test-slave-44d2"
server_key: "94d41c92cda6c6dafbb2ff84e59e8a12"
server_key_iv: "5afc162c1f242438262e8c674abfa404"
server_key_version: "encryptionkey@0"
I20260806 00:57:12.322139 31451 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:57:12.322922 31475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:12.323149 31451 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:57:12.323259 31451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "6317a0928b2649f0bf8039a4d2acfd85"
format_stamp: "Formatted at 2026-08-06 00:57:12 on dist-test-slave-44d2"
server_key: "94d41c92cda6c6dafbb2ff84e59e8a12"
server_key_iv: "5afc162c1f242438262e8c674abfa404"
server_key_version: "encryptionkey@0"
I20260806 00:57:12.323333 31451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:12.341367 31451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:12.343274 31451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:12.343434 31451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:12.347754 31451 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38365
I20260806 00:57:12.347790 31542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38365 every 8 connection(s)
I20260806 00:57:12.348151 31451 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:12.349223 31543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:12.351459 31543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85: Bootstrap starting.
I20260806 00:57:12.352012 31543 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:12.352268 31543 log.cc:824] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:12.352594 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 31451
I20260806 00:57:12.352705 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:12.352931 3466 external_mini_cluster.cc:1428] Setting key befe36b8e78cecf0d198d5aecfb4a038
I20260806 00:57:12.353176 31543 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85: No bootstrap required, opened a new log
I20260806 00:57:12.355084 31543 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317a0928b2649f0bf8039a4d2acfd85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38365 } }
I20260806 00:57:12.355245 31543 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:12.355295 31543 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6317a0928b2649f0bf8039a4d2acfd85, State: Initialized, Role: FOLLOWER
I20260806 00:57:12.355422 31543 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317a0928b2649f0bf8039a4d2acfd85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38365 } }
I20260806 00:57:12.355504 31543 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:12.355535 31543 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:12.355602 31543 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:12.356160 31543 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317a0928b2649f0bf8039a4d2acfd85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38365 } }
I20260806 00:57:12.356248 31543 leader_election.cc:302] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6317a0928b2649f0bf8039a4d2acfd85; no voters:
I20260806 00:57:12.356431 31543 leader_election.cc:288] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:12.356453 31549 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:12.356595 31549 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [term 1 LEADER]: Becoming Leader. State: Replica: 6317a0928b2649f0bf8039a4d2acfd85, State: Running, Role: LEADER
I20260806 00:57:12.356729 31543 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:12.356745 31549 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317a0928b2649f0bf8039a4d2acfd85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38365 } }
I20260806 00:57:12.357146 31549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6317a0928b2649f0bf8039a4d2acfd85. Latest consensus state: current_term: 1 leader_uuid: "6317a0928b2649f0bf8039a4d2acfd85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317a0928b2649f0bf8039a4d2acfd85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38365 } } }
I20260806 00:57:12.357156 31550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6317a0928b2649f0bf8039a4d2acfd85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6317a0928b2649f0bf8039a4d2acfd85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38365 } } }
I20260806 00:57:12.357329 31549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:12.357338 31550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:12.357622 31556 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:12.358242 31556 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:12.359866 31556 catalog_manager.cc:1347] Generated new cluster ID: 42cdcc81b1e3439fb3b01b8d13a838b0
I20260806 00:57:12.359925 31556 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:57:12 dist-test-slave-44d2 krb5kdc[31430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 00:57:12.364696 31548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:12.353499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38443 (local address 127.0.0.1:38365)
0806 00:57:12.353683 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:12.353694 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:12.353733 (+ 39us) server_negotiation.cc:407] Connection header received
0806 00:57:12.354426 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:12.354434 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:12.354480 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:12.354635 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:12.355271 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:12.356770 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:12.357844 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:12.358619 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:12.358738 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:12.361454 (+ 2716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:12.361458 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:12.361458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:12.361469 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:12.363110 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:12.363530 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:12.363532 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:12.363532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:12.363616 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:12.363859 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:12.363860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:12.363860 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:12.364101 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:12.364282 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:12.364370 (+ 88us) server_negotiation.cc:299] Negotiation successful
0806 00:57:12.364469 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":133,"thread_start_us":83,"threads_started":1}
I20260806 00:57:12.365959 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:12.378712 31556 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:12.378722 31548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:12.367325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58563 (local address 127.0.0.1:38365)
0806 00:57:12.367360 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:12.367362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:12.372676 (+ 5314us) server_negotiation.cc:407] Connection header received
0806 00:57:12.372740 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:12.372741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:12.372751 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:12.372794 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:12.373317 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:12.373809 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:12.374541 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:12.374762 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:12.374838 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:12.376039 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:12.376040 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:12.376040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:12.376047 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:12.377446 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:12.377829 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:12.377830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:12.377831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:12.377879 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:12.378098 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:12.378100 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:12.378100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:12.378239 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:12.378346 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:12.378560 (+ 214us) server_negotiation.cc:299] Negotiation successful
0806 00:57:12.378628 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 00:57:12.379331 31556 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:12.385186 31556 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6317a0928b2649f0bf8039a4d2acfd85: Generated new TSK 0
I20260806 00:57:12.385383 31556 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:12.391242 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 31451
W20260806 00:57:12.405802 31427 connection.cc:535] client connection to 127.0.0.1:38365 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38365): Connection reset by peer (error 104)
2026-08-06T00:57:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1519 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:12 dist-test-slave-44d2 krb5kdc[31583](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:12 dist-test-slave-44d2 krb5kdc[31583](info): set up 2 sockets
Aug 06 00:57:12 dist-test-slave-44d2 krb5kdc[31583](info): commencing operation
krb5kdc: starting...
W20260806 00:57:13.609875 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:13 dist-test-slave-44d2 krb5kdc[31583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 00:57:13.735594 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39145
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:13.817991 31606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:13.818209 31606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:13.818233 31606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:13.819397 31606 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:13.819451 31606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:13.819468 31606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:13.819480 31606 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:13.819499 31606 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:13.821051 31606 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39145
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:13.821252 31606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:13.821424 31606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:13.826376 31612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:13.826438 31615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:13.826588 31606 server_base.cc:1034] running on GCE node
W20260806 00:57:13.826423 31613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:13.826951 31606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:13.827253 31606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:13.828423 31606 hybrid_clock.cc:648] HybridClock initialized: now 1785977833828399 us; error 35 us; skew 500 ppm
Aug 06 00:57:13 dist-test-slave-44d2 krb5kdc[31583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977833, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:13.830955 31606 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 00:57:13.831419 31606 webserver.cc:460] Webserver started at http://127.0.0.1:35917/ using document root <none> and password file <none>
I20260806 00:57:13.831661 31606 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:13.831733 31606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:13.831889 31606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:13.833079 31606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "b493b576624a415fad98ddfedf15129b"
format_stamp: "Formatted at 2026-08-06 00:57:13 on dist-test-slave-44d2"
server_key: "d0b1dd117affa48f003cf19af8fdf870"
server_key_iv: "545f27b690e04497ea7b89a0345a0b0d"
server_key_version: "encryptionkey@0"
I20260806 00:57:13.833453 31606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "b493b576624a415fad98ddfedf15129b"
format_stamp: "Formatted at 2026-08-06 00:57:13 on dist-test-slave-44d2"
server_key: "d0b1dd117affa48f003cf19af8fdf870"
server_key_iv: "545f27b690e04497ea7b89a0345a0b0d"
server_key_version: "encryptionkey@0"
I20260806 00:57:13.834811 31606 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:57:13.835557 31626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:13.835731 31606 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:13.835840 31606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "b493b576624a415fad98ddfedf15129b"
format_stamp: "Formatted at 2026-08-06 00:57:13 on dist-test-slave-44d2"
server_key: "d0b1dd117affa48f003cf19af8fdf870"
server_key_iv: "545f27b690e04497ea7b89a0345a0b0d"
server_key_version: "encryptionkey@0"
I20260806 00:57:13.835916 31606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:13.845666 31606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:13.847486 31606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:13.847652 31606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:13.851886 31606 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39145
I20260806 00:57:13.851946 31695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39145 every 8 connection(s)
I20260806 00:57:13.852312 31606 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:13.853391 31696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:13.855629 31696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b: Bootstrap starting.
I20260806 00:57:13.856220 31696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:13.856560 31696 log.cc:824] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:13.857268 31696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b: No bootstrap required, opened a new log
I20260806 00:57:13.858914 31696 raft_consensus.cc:348] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b493b576624a415fad98ddfedf15129b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39145 } }
I20260806 00:57:13.859050 31696 raft_consensus.cc:374] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:13.859095 31696 raft_consensus.cc:729] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b493b576624a415fad98ddfedf15129b, State: Initialized, Role: FOLLOWER
I20260806 00:57:13.859277 31696 consensus_queue.cc:260] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b493b576624a415fad98ddfedf15129b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39145 } }
I20260806 00:57:13.859357 31696 raft_consensus.cc:388] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:13.859398 31696 raft_consensus.cc:482] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:13.859447 31696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:13.859982 31696 raft_consensus.cc:504] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b493b576624a415fad98ddfedf15129b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39145 } }
I20260806 00:57:13.860071 31696 leader_election.cc:302] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b493b576624a415fad98ddfedf15129b; no voters:
I20260806 00:57:13.860234 31696 leader_election.cc:288] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:13.860339 31700 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:13.860543 31696 sys_catalog.cc:564] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:13.860687 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 31606
I20260806 00:57:13.860836 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:13.861034 3466 external_mini_cluster.cc:1428] Setting key fa9bf73b50d58ea52a16dbb0d2d7d25a
I20260806 00:57:13.861217 31700 raft_consensus.cc:686] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [term 1 LEADER]: Becoming Leader. State: Replica: b493b576624a415fad98ddfedf15129b, State: Running, Role: LEADER
I20260806 00:57:13.861354 31700 consensus_queue.cc:237] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b493b576624a415fad98ddfedf15129b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39145 } }
I20260806 00:57:13.861807 31707 sys_catalog.cc:455] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b493b576624a415fad98ddfedf15129b. Latest consensus state: current_term: 1 leader_uuid: "b493b576624a415fad98ddfedf15129b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b493b576624a415fad98ddfedf15129b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39145 } } }
I20260806 00:57:13.861909 31707 sys_catalog.cc:458] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:13.862313 31701 sys_catalog.cc:455] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b493b576624a415fad98ddfedf15129b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b493b576624a415fad98ddfedf15129b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39145 } } }
W20260806 00:57:13.862584 31720 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260806 00:57:13.862624 31701 sys_catalog.cc:458] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b [sys.catalog]: This master's current role is: LEADER
W20260806 00:57:13.862635 31720 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:57:13.862720 31722 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:13.862885 31722 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:13.864457 31722 catalog_manager.cc:1347] Generated new cluster ID: d457b745a10a426d9d55d0fef0b87bf2
I20260806 00:57:13.864540 31722 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:13.867287 31712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:13.861519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35435 (local address 127.0.0.1:39145)
0806 00:57:13.861864 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:13.861873 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:13.861908 (+ 35us) server_negotiation.cc:407] Connection header received
0806 00:57:13.862035 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:13.862043 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:13.862106 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:13.862273 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:13.862539 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:13.863840 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:13.865027 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:13.865635 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:13.865737 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:13.866487 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:13.866492 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:13.866492 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:13.866695 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:13.866731 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:13.866745 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:13.866827 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:13.866946 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 00:57:13.867080 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":97,"threads_started":1}
I20260806 00:57:13.868296 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:13.872473 31722 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:13.872991 31722 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:13.877590 31712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:13.869728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34895 (local address 127.0.0.1:39145)
0806 00:57:13.869768 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:13.869770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:13.869904 (+ 134us) server_negotiation.cc:407] Connection header received
0806 00:57:13.869980 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:13.869981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:13.870002 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:13.870030 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:13.870219 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:13.870927 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:13.871945 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:13.872194 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:13.872237 (+ 43us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:13.877295 (+ 5058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:13.877297 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:13.877297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:13.877302 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:13.877320 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:13.877324 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:13.877386 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:13.877491 (+ 105us) server_negotiation.cc:299] Negotiation successful
0806 00:57:13.877506 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:57:13.879940 31722 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b493b576624a415fad98ddfedf15129b: Generated new TSK 0
I20260806 00:57:13.880141 31722 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:13.884322 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 31606
W20260806 00:57:13.899255 31581 connection.cc:535] client connection to 127.0.0.1:39145 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39145): Connection reset by peer (error 104)
2026-08-06T00:57:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1493 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:13 dist-test-slave-44d2 krb5kdc[31742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:13 dist-test-slave-44d2 krb5kdc[31742](info): set up 2 sockets
Aug 06 00:57:13 dist-test-slave-44d2 krb5kdc[31742](info): commencing operation
krb5kdc: starting...
W20260806 00:57:15.207365 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.294s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:15 dist-test-slave-44d2 krb5kdc[31742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977835, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 00:57:15.335961 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37373
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44981
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:15.424393 31760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:15.424731 31760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:15.424757 31760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:15.425935 31760 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:15.425968 31760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:15.425983 31760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:15.425997 31760 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:15.426014 31760 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:15.427404 31760 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44981
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37373
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31760
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:15.427597 31760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:15.427793 31760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:15.432816 31770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:15.432824 31768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:15.432971 31767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:15.432998 31760 server_base.cc:1034] running on GCE node
I20260806 00:57:15.433298 31760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:15.433610 31760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:15.434784 31760 hybrid_clock.cc:648] HybridClock initialized: now 1785977835434779 us; error 38 us; skew 500 ppm
Aug 06 00:57:15 dist-test-slave-44d2 krb5kdc[31742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977835, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:15.437321 31760 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 00:57:15.437789 31760 webserver.cc:460] Webserver started at http://127.0.0.1:46435/ using document root <none> and password file <none>
I20260806 00:57:15.438040 31760 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:15.438110 31760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:15.438261 31760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:15.439312 31760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "f85143477d704ae8a082bcb3624065ed"
format_stamp: "Formatted at 2026-08-06 00:57:15 on dist-test-slave-44d2"
server_key: "b462b8b234bc462ae7b4a099f51e8b00"
server_key_iv: "3388e60e5f3f1cd6d1fd227008c2cf79"
server_key_version: "encryptionkey@0"
I20260806 00:57:15.439690 31760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "f85143477d704ae8a082bcb3624065ed"
format_stamp: "Formatted at 2026-08-06 00:57:15 on dist-test-slave-44d2"
server_key: "b462b8b234bc462ae7b4a099f51e8b00"
server_key_iv: "3388e60e5f3f1cd6d1fd227008c2cf79"
server_key_version: "encryptionkey@0"
I20260806 00:57:15.441123 31760 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 00:57:15.441900 31779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:15.442090 31760 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:15.442196 31760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "f85143477d704ae8a082bcb3624065ed"
format_stamp: "Formatted at 2026-08-06 00:57:15 on dist-test-slave-44d2"
server_key: "b462b8b234bc462ae7b4a099f51e8b00"
server_key_iv: "3388e60e5f3f1cd6d1fd227008c2cf79"
server_key_version: "encryptionkey@0"
I20260806 00:57:15.442269 31760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:15.445600 31760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:15.447513 31760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:15.447667 31760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:15.451905 31760 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37373
I20260806 00:57:15.452025 31850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37373 every 8 connection(s)
I20260806 00:57:15.452293 31760 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:15.453480 31851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:15.456063 31851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed: Bootstrap starting.
I20260806 00:57:15.456801 31851 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:15.457157 31851 log.cc:824] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:15.458020 31851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed: No bootstrap required, opened a new log
I20260806 00:57:15.459909 31851 raft_consensus.cc:348] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85143477d704ae8a082bcb3624065ed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37373 } }
I20260806 00:57:15.460064 31851 raft_consensus.cc:374] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:15.460093 31851 raft_consensus.cc:729] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f85143477d704ae8a082bcb3624065ed, State: Initialized, Role: FOLLOWER
I20260806 00:57:15.460276 31851 consensus_queue.cc:260] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85143477d704ae8a082bcb3624065ed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37373 } }
I20260806 00:57:15.460357 31851 raft_consensus.cc:388] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:15.460450 31851 raft_consensus.cc:482] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:15.460541 31851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:15.461180 31851 raft_consensus.cc:504] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85143477d704ae8a082bcb3624065ed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37373 } }
I20260806 00:57:15.461217 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 31760
I20260806 00:57:15.461354 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:15.461320 31851 leader_election.cc:302] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f85143477d704ae8a082bcb3624065ed; no voters:
I20260806 00:57:15.461562 31851 leader_election.cc:288] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:15.461556 3466 external_mini_cluster.cc:1428] Setting key 9e4892981e966c00cd9e8ab3df34a12a
I20260806 00:57:15.461601 31855 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:15.461750 31855 raft_consensus.cc:686] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [term 1 LEADER]: Becoming Leader. State: Replica: f85143477d704ae8a082bcb3624065ed, State: Running, Role: LEADER
I20260806 00:57:15.461918 31855 consensus_queue.cc:237] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85143477d704ae8a082bcb3624065ed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37373 } }
I20260806 00:57:15.461918 31851 sys_catalog.cc:564] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:15.462536 31856 sys_catalog.cc:455] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f85143477d704ae8a082bcb3624065ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85143477d704ae8a082bcb3624065ed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37373 } } }
I20260806 00:57:15.462541 31858 sys_catalog.cc:455] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader f85143477d704ae8a082bcb3624065ed. Latest consensus state: current_term: 1 leader_uuid: "f85143477d704ae8a082bcb3624065ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f85143477d704ae8a082bcb3624065ed" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37373 } } }
I20260806 00:57:15.462669 31858 sys_catalog.cc:458] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:15.462651 31856 sys_catalog.cc:458] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:15.462890 31863 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:15.463725 31863 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:15.465101 31860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:15.462049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58669 (local address 127.0.0.1:37373)
0806 00:57:15.462934 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:15.462945 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:15.462986 (+ 41us) server_negotiation.cc:407] Connection header received
0806 00:57:15.463121 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:15.463128 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:15.463166 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:15.463741 (+ 575us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:15.464309 (+ 568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:15.464313 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:15.464313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:15.464318 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:15.464387 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:15.464406 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:15.464568 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:15.464768 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 00:57:15.464819 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":820,"thread_start_us":90,"threads_started":1}
I20260806 00:57:15.465690 31863 catalog_manager.cc:1347] Generated new cluster ID: b120a355ed4a4b71936e22b3c312050d
I20260806 00:57:15.465754 31863 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:15.466184 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:15.469208 31860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:15.467903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34457 (local address 127.0.0.1:37373)
0806 00:57:15.467962 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:15.467964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:15.468027 (+ 63us) server_negotiation.cc:407] Connection header received
0806 00:57:15.468156 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:15.468157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:15.468163 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:15.468239 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:15.468921 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:15.468923 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:15.468923 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:15.468928 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:15.468945 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:15.468950 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:15.469022 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:15.469087 (+ 65us) server_negotiation.cc:299] Negotiation successful
0806 00:57:15.469102 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 00:57:15.486186 31863 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:15.486383 31863 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:15.495959 31863 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f85143477d704ae8a082bcb3624065ed: Generated new TSK 0
I20260806 00:57:15.496186 31863 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:15.501489 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 31760
2026-08-06T00:57:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1614 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:15 dist-test-slave-44d2 krb5kdc[31894](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:15 dist-test-slave-44d2 krb5kdc[31894](info): set up 2 sockets
Aug 06 00:57:15 dist-test-slave-44d2 krb5kdc[31894](info): commencing operation
krb5kdc: starting...
W20260806 00:57:16.785657 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:16 dist-test-slave-44d2 krb5kdc[31894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 00:57:16.908798 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46297
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:16.996179 31913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:16.996423 31913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:16.996464 31913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:16.997624 31913 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:16.997696 31913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:16.997722 31913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:16.997758 31913 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:16.997788 31913 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:16.999254 31913 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46297
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:16.999539 31913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:16.999759 31913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:17.004850 31918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:17.004894 31919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:17.004914 31921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:17.004856 31913 server_base.cc:1034] running on GCE node
I20260806 00:57:17.005390 31913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:17.005645 31913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:17.006784 31913 hybrid_clock.cc:648] HybridClock initialized: now 1785977837006775 us; error 33 us; skew 500 ppm
Aug 06 00:57:17 dist-test-slave-44d2 krb5kdc[31894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977837, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:17.009320 31913 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 00:57:17.009752 31913 webserver.cc:460] Webserver started at http://127.0.0.1:41341/ using document root <none> and password file <none>
I20260806 00:57:17.009984 31913 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:17.010036 31913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:17.010191 31913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:17.011236 31913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "149fdcea123744fc8347b887e4840f37"
format_stamp: "Formatted at 2026-08-06 00:57:17 on dist-test-slave-44d2"
server_key: "f1ec7e736a7df5ae57c8c8112acc4992"
server_key_iv: "07fca0975635091dca5e3c98646972e0"
server_key_version: "encryptionkey@0"
I20260806 00:57:17.011608 31913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "149fdcea123744fc8347b887e4840f37"
format_stamp: "Formatted at 2026-08-06 00:57:17 on dist-test-slave-44d2"
server_key: "f1ec7e736a7df5ae57c8c8112acc4992"
server_key_iv: "07fca0975635091dca5e3c98646972e0"
server_key_version: "encryptionkey@0"
I20260806 00:57:17.013093 31913 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 00:57:17.013882 31928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:17.014084 31913 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:17.014171 31913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "149fdcea123744fc8347b887e4840f37"
format_stamp: "Formatted at 2026-08-06 00:57:17 on dist-test-slave-44d2"
server_key: "f1ec7e736a7df5ae57c8c8112acc4992"
server_key_iv: "07fca0975635091dca5e3c98646972e0"
server_key_version: "encryptionkey@0"
I20260806 00:57:17.014225 31913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:17.032058 31913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:17.034538 31913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:17.034654 31913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:17.038695 31913 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46297
I20260806 00:57:17.038777 31997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46297 every 8 connection(s)
I20260806 00:57:17.039129 31913 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:17.040154 31998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:17.042435 31998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37: Bootstrap starting.
I20260806 00:57:17.042981 31998 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:17.043222 31998 log.cc:824] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:17.043917 31998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37: No bootstrap required, opened a new log
I20260806 00:57:17.043924 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 31913
I20260806 00:57:17.044055 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:17.044257 3466 external_mini_cluster.cc:1428] Setting key dbc654594057df847de2e23b00e663b8
I20260806 00:57:17.045930 31998 raft_consensus.cc:348] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149fdcea123744fc8347b887e4840f37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46297 } }
I20260806 00:57:17.046094 31998 raft_consensus.cc:374] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:17.046164 31998 raft_consensus.cc:729] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 149fdcea123744fc8347b887e4840f37, State: Initialized, Role: FOLLOWER
I20260806 00:57:17.046343 31998 consensus_queue.cc:260] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149fdcea123744fc8347b887e4840f37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46297 } }
I20260806 00:57:17.046440 31998 raft_consensus.cc:388] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:17.046479 31998 raft_consensus.cc:482] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:17.046543 31998 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:17.047542 31998 raft_consensus.cc:504] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149fdcea123744fc8347b887e4840f37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46297 } }
I20260806 00:57:17.047636 31998 leader_election.cc:302] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 149fdcea123744fc8347b887e4840f37; no voters:
I20260806 00:57:17.047854 31998 leader_election.cc:288] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:17.047880 32003 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:17.047995 32003 raft_consensus.cc:686] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [term 1 LEADER]: Becoming Leader. State: Replica: 149fdcea123744fc8347b887e4840f37, State: Running, Role: LEADER
I20260806 00:57:17.048123 31998 sys_catalog.cc:564] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:17.048152 32003 consensus_queue.cc:237] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149fdcea123744fc8347b887e4840f37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46297 } }
I20260806 00:57:17.048473 32003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 149fdcea123744fc8347b887e4840f37. Latest consensus state: current_term: 1 leader_uuid: "149fdcea123744fc8347b887e4840f37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149fdcea123744fc8347b887e4840f37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46297 } } }
I20260806 00:57:17.048615 32003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:17.048506 32004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "149fdcea123744fc8347b887e4840f37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "149fdcea123744fc8347b887e4840f37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46297 } } }
I20260806 00:57:17.048951 32004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:17.048870 32012 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:17.049590 32012 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:17.051265 32012 catalog_manager.cc:1347] Generated new cluster ID: 59ea4b317501494db40ee8daeb18affd
I20260806 00:57:17.051328 32012 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:57:17 dist-test-slave-44d2 krb5kdc[31894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 00:57:17.056869 32002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:17.044814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44415 (local address 127.0.0.1:46297)
0806 00:57:17.045049 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:17.045058 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:17.045093 (+ 35us) server_negotiation.cc:407] Connection header received
0806 00:57:17.045924 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:17.045932 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:17.045988 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:17.046108 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:17.047018 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:17.048126 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:17.049240 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:17.049845 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:17.049945 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:17.052920 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:17.052924 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:17.052924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:17.052935 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:17.054920 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:17.055285 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:17.055287 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:17.055288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:17.055408 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:17.055591 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:17.055592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:17.055592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:17.055874 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:17.056003 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:17.056463 (+ 460us) server_negotiation.cc:299] Negotiation successful
0806 00:57:17.056649 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":148,"threads_started":1}
I20260806 00:57:17.057873 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:17.065541 32012 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:17.066215 32012 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:17.066931 32002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:17.059237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48735 (local address 127.0.0.1:46297)
0806 00:57:17.059274 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:17.059275 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:17.059462 (+ 187us) server_negotiation.cc:407] Connection header received
0806 00:57:17.059517 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:17.059518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:17.059528 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:17.059592 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:17.060212 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:17.060967 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:17.061979 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:17.062296 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:17.062357 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:17.063740 (+ 1383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:17.063741 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:17.063742 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:17.063749 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:17.065461 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:17.065856 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:17.065858 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:17.065858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:17.065918 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:17.066149 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:17.066150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:17.066150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:17.066281 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:17.066397 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:17.066764 (+ 367us) server_negotiation.cc:299] Negotiation successful
0806 00:57:17.066844 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:57:17.076426 32012 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 149fdcea123744fc8347b887e4840f37: Generated new TSK 0
I20260806 00:57:17.076653 32012 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:17.081475 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 31913
2026-08-06T00:57:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1581 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:17 dist-test-slave-44d2 krb5kdc[32034](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:17 dist-test-slave-44d2 krb5kdc[32034](info): set up 2 sockets
Aug 06 00:57:17 dist-test-slave-44d2 krb5kdc[32034](info): commencing operation
krb5kdc: starting...
W20260806 00:57:18.343032 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:18 dist-test-slave-44d2 krb5kdc[32034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 00:57:18.475723 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36255
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36255
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:18.561901 32055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:18.562161 32055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:18.562203 32055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:18.563385 32055 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:18.563460 32055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:18.563485 32055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:18.563508 32055 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:18.563537 32055 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:18.565080 32055 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36255
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36255
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:18.565382 32055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:18.565626 32055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:18.570865 32064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:18.570891 32061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:18.570959 32062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:18.571091 32055 server_base.cc:1034] running on GCE node
I20260806 00:57:18.571367 32055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:18.571674 32055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:18.572853 32055 hybrid_clock.cc:648] HybridClock initialized: now 1785977838572844 us; error 40 us; skew 500 ppm
Aug 06 00:57:18 dist-test-slave-44d2 krb5kdc[32034](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977838, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:18.575484 32055 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 00:57:18.575964 32055 webserver.cc:460] Webserver started at http://127.0.0.1:44591/ using document root <none> and password file <none>
I20260806 00:57:18.576211 32055 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:18.576283 32055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:18.576440 32055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:18.577638 32055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "e4a7154da68a44a8813a39dac8222f85"
format_stamp: "Formatted at 2026-08-06 00:57:18 on dist-test-slave-44d2"
server_key: "c23fe6653d92852ca0883a3fe596ce9d"
server_key_iv: "9c5dd771085cec23399a4e448e379d03"
server_key_version: "encryptionkey@0"
I20260806 00:57:18.578025 32055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "e4a7154da68a44a8813a39dac8222f85"
format_stamp: "Formatted at 2026-08-06 00:57:18 on dist-test-slave-44d2"
server_key: "c23fe6653d92852ca0883a3fe596ce9d"
server_key_iv: "9c5dd771085cec23399a4e448e379d03"
server_key_version: "encryptionkey@0"
I20260806 00:57:18.579380 32055 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:18.580166 32075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:18.580335 32055 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:18.580448 32055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "e4a7154da68a44a8813a39dac8222f85"
format_stamp: "Formatted at 2026-08-06 00:57:18 on dist-test-slave-44d2"
server_key: "c23fe6653d92852ca0883a3fe596ce9d"
server_key_iv: "9c5dd771085cec23399a4e448e379d03"
server_key_version: "encryptionkey@0"
I20260806 00:57:18.580596 32055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:18.588719 32055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:18.590584 32055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:18.590754 32055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:18.595158 32055 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36255
I20260806 00:57:18.595207 32140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36255 every 8 connection(s)
I20260806 00:57:18.595603 32055 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:18.596710 32142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:18.599051 32142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85: Bootstrap starting.
I20260806 00:57:18.599671 32142 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:18.599978 32142 log.cc:824] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:18.600782 32142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85: No bootstrap required, opened a new log
I20260806 00:57:18.601545 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 32055
I20260806 00:57:18.601713 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:18.601948 3466 external_mini_cluster.cc:1428] Setting key e815cc4f17b8af068aa21015cfbce4b7
I20260806 00:57:18.602859 32142 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a7154da68a44a8813a39dac8222f85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36255 } }
I20260806 00:57:18.603120 32142 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:18.603173 32142 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4a7154da68a44a8813a39dac8222f85, State: Initialized, Role: FOLLOWER
I20260806 00:57:18.603313 32142 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a7154da68a44a8813a39dac8222f85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36255 } }
I20260806 00:57:18.603425 32142 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:18.603469 32142 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:18.603513 32142 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:18.604089 32142 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a7154da68a44a8813a39dac8222f85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36255 } }
I20260806 00:57:18.604178 32142 leader_election.cc:302] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4a7154da68a44a8813a39dac8222f85; no voters:
I20260806 00:57:18.604358 32142 leader_election.cc:288] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:18.604390 32151 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:18.604589 32151 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [term 1 LEADER]: Becoming Leader. State: Replica: e4a7154da68a44a8813a39dac8222f85, State: Running, Role: LEADER
I20260806 00:57:18.604661 32142 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:18.604734 32151 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a7154da68a44a8813a39dac8222f85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36255 } }
I20260806 00:57:18.605165 32151 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4a7154da68a44a8813a39dac8222f85. Latest consensus state: current_term: 1 leader_uuid: "e4a7154da68a44a8813a39dac8222f85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a7154da68a44a8813a39dac8222f85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36255 } } }
I20260806 00:57:18.605265 32151 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:18.605434 32152 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4a7154da68a44a8813a39dac8222f85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4a7154da68a44a8813a39dac8222f85" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36255 } } }
I20260806 00:57:18.605501 32152 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:18.605618 32160 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:18.606397 32160 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:18.608088 32160 catalog_manager.cc:1347] Generated new cluster ID: 162a9810cbb54a8fbf16cba2c552c6cd
I20260806 00:57:18.608142 32160 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:18.609215 32149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:18.602579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49859 (local address 127.0.0.1:36255)
0806 00:57:18.602778 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:18.602788 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:18.602825 (+ 37us) server_negotiation.cc:407] Connection header received
0806 00:57:18.602934 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:18.602960 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:18.603022 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:18.603189 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:18.603481 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:18.605438 (+ 1957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:18.606755 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:18.607399 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:18.607554 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:18.608418 (+ 864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:18.608422 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:18.608422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:18.608702 (+ 280us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:18.608736 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:18.608749 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:18.608832 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:18.608939 (+ 107us) server_negotiation.cc:299] Negotiation successful
0806 00:57:18.609011 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":112,"threads_started":1}
I20260806 00:57:18.613829 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:18.617254 32160 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:18.617935 32160 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:18.619029 32149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:18.615371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44307 (local address 127.0.0.1:36255)
0806 00:57:18.615419 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:18.615422 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:18.615557 (+ 135us) server_negotiation.cc:407] Connection header received
0806 00:57:18.615639 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:18.615640 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:18.615652 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:18.615702 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:18.615890 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:18.616534 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:18.617568 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:18.617800 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:18.617891 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:18.618706 (+ 815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:18.618708 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:18.618708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:18.618715 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:18.618731 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:18.618736 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:18.618796 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:18.618869 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 00:57:18.618916 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:57:18.624171 32160 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4a7154da68a44a8813a39dac8222f85: Generated new TSK 0
I20260806 00:57:18.624393 32160 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:18.628433 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 32055
2026-08-06T00:57:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1547 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:18 dist-test-slave-44d2 krb5kdc[32185](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:18 dist-test-slave-44d2 krb5kdc[32185](info): set up 2 sockets
Aug 06 00:57:18 dist-test-slave-44d2 krb5kdc[32185](info): commencing operation
krb5kdc: starting...
W20260806 00:57:19.861521 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:19 dist-test-slave-44d2 krb5kdc[32185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977839, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 00:57:19.988399 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37597
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37597
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:20.076105 32203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:20.076370 32203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:20.076397 32203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:20.077776 32203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:20.077840 32203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:20.077858 32203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:20.077873 32203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:20.077886 32203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:20.079433 32203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37597
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37597
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:20.079702 32203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:20.079962 32203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:20.085289 32214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:20.085294 32212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:20.085414 32211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:20.086488 32203 server_base.cc:1034] running on GCE node
I20260806 00:57:20.086849 32203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:20.087199 32203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:20.088414 32203 hybrid_clock.cc:648] HybridClock initialized: now 1785977840088388 us; error 43 us; skew 500 ppm
Aug 06 00:57:20 dist-test-slave-44d2 krb5kdc[32185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977840, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:20.091292 32203 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 00:57:20.091830 32203 webserver.cc:460] Webserver started at http://127.0.0.1:38961/ using document root <none> and password file <none>
I20260806 00:57:20.092079 32203 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:20.092154 32203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:20.092319 32203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:20.094074 32203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "7ccce845888f4f10a541f684b3f9fe35"
format_stamp: "Formatted at 2026-08-06 00:57:20 on dist-test-slave-44d2"
server_key: "4788da683564ec81c08df48ab1d04a95"
server_key_iv: "d56f154bf97200974baf4517f9636e90"
server_key_version: "encryptionkey@0"
I20260806 00:57:20.094486 32203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "7ccce845888f4f10a541f684b3f9fe35"
format_stamp: "Formatted at 2026-08-06 00:57:20 on dist-test-slave-44d2"
server_key: "4788da683564ec81c08df48ab1d04a95"
server_key_iv: "d56f154bf97200974baf4517f9636e90"
server_key_version: "encryptionkey@0"
I20260806 00:57:20.096028 32203 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:20.096992 32225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:20.097198 32203 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 00:57:20.097325 32203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "7ccce845888f4f10a541f684b3f9fe35"
format_stamp: "Formatted at 2026-08-06 00:57:20 on dist-test-slave-44d2"
server_key: "4788da683564ec81c08df48ab1d04a95"
server_key_iv: "d56f154bf97200974baf4517f9636e90"
server_key_version: "encryptionkey@0"
I20260806 00:57:20.097424 32203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:20.101382 32203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:20.103574 32203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:20.103758 32203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:20.108736 32203 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37597
I20260806 00:57:20.108765 32288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37597 every 8 connection(s)
I20260806 00:57:20.109136 32203 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:20.110234 32289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:20.112411 32289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35: Bootstrap starting.
I20260806 00:57:20.113092 32289 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:20.113332 32289 log.cc:824] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:20.113991 32289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35: No bootstrap required, opened a new log
I20260806 00:57:20.114259 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 32203
I20260806 00:57:20.114398 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:20.114610 3466 external_mini_cluster.cc:1428] Setting key 6da2f0421f4ec6abeaa7dea09bfa60bf
I20260806 00:57:20.116340 32289 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ccce845888f4f10a541f684b3f9fe35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37597 } }
I20260806 00:57:20.116573 32289 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:20.116612 32289 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ccce845888f4f10a541f684b3f9fe35, State: Initialized, Role: FOLLOWER
I20260806 00:57:20.116750 32289 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ccce845888f4f10a541f684b3f9fe35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37597 } }
I20260806 00:57:20.116837 32289 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:20.116873 32289 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:20.116926 32289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:20.117480 32289 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ccce845888f4f10a541f684b3f9fe35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37597 } }
I20260806 00:57:20.117622 32289 leader_election.cc:302] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ccce845888f4f10a541f684b3f9fe35; no voters:
I20260806 00:57:20.117802 32289 leader_election.cc:288] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:20.117990 32299 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:20.118067 32289 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:20.118031 32297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:20.115152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32791 (local address 127.0.0.1:37597)
0806 00:57:20.115382 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:20.115392 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:20.115430 (+ 38us) server_negotiation.cc:407] Connection header received
0806 00:57:20.116574 (+ 1144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:20.116584 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:20.116622 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:20.116781 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:20.117583 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:20.117587 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:20.117587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:20.117592 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:20.117641 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:20.117656 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:20.117734 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:20.117806 (+ 72us) server_negotiation.cc:299] Negotiation successful
0806 00:57:20.117850 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":101,"threads_started":1}
I20260806 00:57:20.118216 32299 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [term 1 LEADER]: Becoming Leader. State: Replica: 7ccce845888f4f10a541f684b3f9fe35, State: Running, Role: LEADER
I20260806 00:57:20.118325 32299 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ccce845888f4f10a541f684b3f9fe35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37597 } }
I20260806 00:57:20.118683 32299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ccce845888f4f10a541f684b3f9fe35. Latest consensus state: current_term: 1 leader_uuid: "7ccce845888f4f10a541f684b3f9fe35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ccce845888f4f10a541f684b3f9fe35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37597 } } }
I20260806 00:57:20.118767 32299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:20.118916 32304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ccce845888f4f10a541f684b3f9fe35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ccce845888f4f10a541f684b3f9fe35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37597 } } }
I20260806 00:57:20.119026 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:20.119046 32304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35 [sys.catalog]: This master's current role is: LEADER
W20260806 00:57:20.120008 32320 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 00:57:20.120070 32320 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:57:20.120116 32313 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:20.120267 32313 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:20.121960 32313 catalog_manager.cc:1347] Generated new cluster ID: 8e17693742ba4c3ba6bb71d17be350a8
I20260806 00:57:20.122025 32313 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:20.122305 32297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:20.120971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51501 (local address 127.0.0.1:37597)
0806 00:57:20.121037 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:20.121039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:20.121110 (+ 71us) server_negotiation.cc:407] Connection header received
0806 00:57:20.121185 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:20.121185 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:20.121191 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:20.121247 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:20.121997 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:20.121999 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:20.121999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:20.122004 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:20.122019 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:20.122023 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:20.122086 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:20.122221 (+ 135us) server_negotiation.cc:299] Negotiation successful
0806 00:57:20.122237 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 00:57:20.141884 32313 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:20.142105 32313 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:20.146338 32313 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ccce845888f4f10a541f684b3f9fe35: Generated new TSK 0
I20260806 00:57:20.146552 32313 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:20.152632 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 32203
2026-08-06T00:57:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1524 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:20 dist-test-slave-44d2 krb5kdc[32335](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:20 dist-test-slave-44d2 krb5kdc[32335](info): set up 2 sockets
Aug 06 00:57:20 dist-test-slave-44d2 krb5kdc[32335](info): commencing operation
krb5kdc: starting...
W20260806 00:57:21.511089 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:21 dist-test-slave-44d2 krb5kdc[32335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 00:57:21.634776 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43937
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43937
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:21.717726 32350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:21.717943 32350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:21.717967 32350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:21.719134 32350 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:21.719179 32350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:21.719242 32350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:21.719276 32350 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:21.719300 32350 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:21.720822 32350 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43937
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:21.721086 32350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:21.721341 32350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:21.726392 32356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:21.726377 32357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:21.726438 32350 server_base.cc:1034] running on GCE node
W20260806 00:57:21.726373 32362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:21.726856 32350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:21.727123 32350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:21.728267 32350 hybrid_clock.cc:648] HybridClock initialized: now 1785977841728254 us; error 30 us; skew 500 ppm
Aug 06 00:57:21 dist-test-slave-44d2 krb5kdc[32335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977841, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:21.730808 32350 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 00:57:21.731248 32350 webserver.cc:460] Webserver started at http://127.0.0.1:44241/ using document root <none> and password file <none>
I20260806 00:57:21.731479 32350 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:21.731549 32350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:21.731714 32350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:21.732897 32350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "dd5bdaf139d94d2ea31d1cbe297f7671"
format_stamp: "Formatted at 2026-08-06 00:57:21 on dist-test-slave-44d2"
server_key: "d1ed51d7edfd03a39b8c74c17db83387"
server_key_iv: "d10ea0c5a573019ad3a483d12f09042d"
server_key_version: "encryptionkey@0"
I20260806 00:57:21.733281 32350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "dd5bdaf139d94d2ea31d1cbe297f7671"
format_stamp: "Formatted at 2026-08-06 00:57:21 on dist-test-slave-44d2"
server_key: "d1ed51d7edfd03a39b8c74c17db83387"
server_key_iv: "d10ea0c5a573019ad3a483d12f09042d"
server_key_version: "encryptionkey@0"
I20260806 00:57:21.734632 32350 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:57:21.735363 32371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:21.735581 32350 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:21.735692 32350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "dd5bdaf139d94d2ea31d1cbe297f7671"
format_stamp: "Formatted at 2026-08-06 00:57:21 on dist-test-slave-44d2"
server_key: "d1ed51d7edfd03a39b8c74c17db83387"
server_key_iv: "d10ea0c5a573019ad3a483d12f09042d"
server_key_version: "encryptionkey@0"
I20260806 00:57:21.735773 32350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:21.747816 32350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:21.749739 32350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:21.749902 32350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:21.754168 32350 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43937
I20260806 00:57:21.754199 32435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43937 every 8 connection(s)
I20260806 00:57:21.754551 32350 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:21.755594 32436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:21.757979 32436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671: Bootstrap starting.
I20260806 00:57:21.758582 32436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:21.758886 32436 log.cc:824] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:21.759518 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 32350
I20260806 00:57:21.759598 32436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671: No bootstrap required, opened a new log
I20260806 00:57:21.759683 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:21.759900 3466 external_mini_cluster.cc:1428] Setting key fbc77bfdc7d72989b1a65eeb579219ad
I20260806 00:57:21.762018 32436 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd5bdaf139d94d2ea31d1cbe297f7671" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43937 } }
I20260806 00:57:21.762200 32436 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:21.762240 32436 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd5bdaf139d94d2ea31d1cbe297f7671, State: Initialized, Role: FOLLOWER
I20260806 00:57:21.762394 32436 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd5bdaf139d94d2ea31d1cbe297f7671" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43937 } }
I20260806 00:57:21.762473 32436 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:21.762504 32436 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:21.762549 32436 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:21.763242 32436 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd5bdaf139d94d2ea31d1cbe297f7671" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43937 } }
I20260806 00:57:21.763351 32436 leader_election.cc:302] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd5bdaf139d94d2ea31d1cbe297f7671; no voters:
I20260806 00:57:21.763499 32436 leader_election.cc:288] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:21.763559 32444 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:21.763702 32444 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [term 1 LEADER]: Becoming Leader. State: Replica: dd5bdaf139d94d2ea31d1cbe297f7671, State: Running, Role: LEADER
I20260806 00:57:21.763722 32436 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:21.763813 32444 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd5bdaf139d94d2ea31d1cbe297f7671" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43937 } }
I20260806 00:57:21.764140 32444 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd5bdaf139d94d2ea31d1cbe297f7671. Latest consensus state: current_term: 1 leader_uuid: "dd5bdaf139d94d2ea31d1cbe297f7671" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd5bdaf139d94d2ea31d1cbe297f7671" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43937 } } }
I20260806 00:57:21.764242 32444 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:21.764153 32447 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd5bdaf139d94d2ea31d1cbe297f7671" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd5bdaf139d94d2ea31d1cbe297f7671" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43937 } } }
I20260806 00:57:21.764336 32447 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:21.764472 32454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:21.765021 32454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:21.767493 32454 catalog_manager.cc:1347] Generated new cluster ID: e9cef9df2ad04891851796d5ab958c44
I20260806 00:57:21.767565 32454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:57:21 dist-test-slave-44d2 krb5kdc[32335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 00:57:21.772723 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:21.760518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.58:40711 (local address 127.0.0.1:43937)
0806 00:57:21.760709 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:21.760719 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:21.760754 (+ 35us) server_negotiation.cc:407] Connection header received
0806 00:57:21.761202 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:21.761211 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:21.761275 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:21.761426 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:21.762023 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:21.763724 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:21.764991 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:21.765620 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:21.765733 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:21.768888 (+ 3155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:21.768892 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:21.768892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:21.768904 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:21.770943 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:21.771437 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:21.771440 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:21.771441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:21.771542 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:21.771792 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:21.771792 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:21.771793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:21.772081 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:21.772238 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:21.772387 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 00:57:21.772514 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":85,"threads_started":1}
I20260806 00:57:21.773792 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:21.780843 32454 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:21.781594 32454 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:21.782629 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:21.775341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.58:58037 (local address 127.0.0.1:43937)
0806 00:57:21.775380 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:21.775382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:21.775392 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:57:21.775448 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:21.775449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:21.775460 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:21.775516 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:21.776103 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:21.776887 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:21.777872 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:21.778197 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:21.778271 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:21.779617 (+ 1346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:21.779618 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:21.779618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:21.779625 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:21.781385 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:21.781801 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:21.781802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:21.781803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:21.781858 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:21.782110 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:21.782111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:21.782111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:21.782228 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:21.782332 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:21.782484 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 00:57:21.782546 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:57:21.784696 32454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd5bdaf139d94d2ea31d1cbe297f7671: Generated new TSK 0
I20260806 00:57:21.784888 32454 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:21.789120 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 32350
W20260806 00:57:21.799775 32331 connection.cc:535] client connection to 127.0.0.1:43937 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43937): Connection reset by peer (error 104)
2026-08-06T00:57:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1634 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:21 dist-test-slave-44d2 krb5kdc[32476](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:21 dist-test-slave-44d2 krb5kdc[32476](info): set up 2 sockets
Aug 06 00:57:21 dist-test-slave-44d2 krb5kdc[32476](info): commencing operation
krb5kdc: starting...
W20260806 00:57:23.034809 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.220s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:23 dist-test-slave-44d2 krb5kdc[32476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977843, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 00:57:23.163368 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40885
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40885
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:23.246524 32492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:23.246769 32492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:23.246809 32492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:23.247998 32492 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:23.248066 32492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:23.248092 32492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:23.248122 32492 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:23.248153 32492 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:23.249677 32492 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:23.249976 32492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:23.250217 32492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:23.255138 32501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:23.255223 32500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:23.255209 32492 server_base.cc:1034] running on GCE node
W20260806 00:57:23.255142 32504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:23.255622 32492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:23.255865 32492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:23.257041 32492 hybrid_clock.cc:648] HybridClock initialized: now 1785977843257028 us; error 46 us; skew 500 ppm
Aug 06 00:57:23 dist-test-slave-44d2 krb5kdc[32476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977843, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:23.263180 32492 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 00:57:23.263708 32492 webserver.cc:460] Webserver started at http://127.0.0.1:38659/ using document root <none> and password file <none>
I20260806 00:57:23.263974 32492 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:23.264060 32492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:23.264211 32492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:23.265363 32492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "3f8f0853d9e44e3186c2005ecf23e6c1"
format_stamp: "Formatted at 2026-08-06 00:57:23 on dist-test-slave-44d2"
server_key: "6218763dae46066078fe072d17ff442f"
server_key_iv: "917756345bfad025c1db1aff7c9527d2"
server_key_version: "encryptionkey@0"
I20260806 00:57:23.265733 32492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "3f8f0853d9e44e3186c2005ecf23e6c1"
format_stamp: "Formatted at 2026-08-06 00:57:23 on dist-test-slave-44d2"
server_key: "6218763dae46066078fe072d17ff442f"
server_key_iv: "917756345bfad025c1db1aff7c9527d2"
server_key_version: "encryptionkey@0"
I20260806 00:57:23.267099 32492 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 00:57:23.267881 32516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:23.268083 32492 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:57:23.268196 32492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "3f8f0853d9e44e3186c2005ecf23e6c1"
format_stamp: "Formatted at 2026-08-06 00:57:23 on dist-test-slave-44d2"
server_key: "6218763dae46066078fe072d17ff442f"
server_key_iv: "917756345bfad025c1db1aff7c9527d2"
server_key_version: "encryptionkey@0"
I20260806 00:57:23.268272 32492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:23.282413 32492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:23.284886 32492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:23.285065 32492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:23.289578 32492 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40885
I20260806 00:57:23.289649 32579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40885 every 8 connection(s)
I20260806 00:57:23.290036 32492 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:23.291019 32580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:23.293457 32580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1: Bootstrap starting.
I20260806 00:57:23.294080 32580 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:23.294374 32580 log.cc:824] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:23.295107 32580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1: No bootstrap required, opened a new log
I20260806 00:57:23.296788 32580 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8f0853d9e44e3186c2005ecf23e6c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40885 } }
I20260806 00:57:23.296928 32580 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:23.296950 32580 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f8f0853d9e44e3186c2005ecf23e6c1, State: Initialized, Role: FOLLOWER
I20260806 00:57:23.297646 32580 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8f0853d9e44e3186c2005ecf23e6c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40885 } }
I20260806 00:57:23.297746 32580 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:23.297772 32580 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:23.297851 32580 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:23.298379 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 32492
I20260806 00:57:23.298534 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:23.298524 32580 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8f0853d9e44e3186c2005ecf23e6c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40885 } }
I20260806 00:57:23.298664 32580 leader_election.cc:302] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f8f0853d9e44e3186c2005ecf23e6c1; no voters:
I20260806 00:57:23.298822 3466 external_mini_cluster.cc:1428] Setting key 48325c17846c2c4a52d42d073dd56e05
I20260806 00:57:23.298884 32580 leader_election.cc:288] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:23.298909 32583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:23.299058 32583 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [term 1 LEADER]: Becoming Leader. State: Replica: 3f8f0853d9e44e3186c2005ecf23e6c1, State: Running, Role: LEADER
I20260806 00:57:23.299197 32580 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:23.299237 32583 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8f0853d9e44e3186c2005ecf23e6c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40885 } }
I20260806 00:57:23.299664 32586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f8f0853d9e44e3186c2005ecf23e6c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8f0853d9e44e3186c2005ecf23e6c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40885 } } }
I20260806 00:57:23.299760 32586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:23.299710 32584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f8f0853d9e44e3186c2005ecf23e6c1. Latest consensus state: current_term: 1 leader_uuid: "3f8f0853d9e44e3186c2005ecf23e6c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f8f0853d9e44e3186c2005ecf23e6c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40885 } } }
I20260806 00:57:23.299817 32584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:23.300870 32594 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:23.301584 32594 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:23.304474 32594 catalog_manager.cc:1347] Generated new cluster ID: 15cf1eb149a44b50b4e5b37000610435
I20260806 00:57:23.304563 32594 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:23.305577 32602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:23.299943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.58:55651 (local address 127.0.0.1:40885)
0806 00:57:23.300124 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:23.300134 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:23.300173 (+ 39us) server_negotiation.cc:407] Connection header received
0806 00:57:23.300288 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:23.300293 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:23.300383 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:23.300896 (+ 513us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:23.301035 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:23.302245 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:23.303417 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:23.303863 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:23.303959 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:23.304824 (+ 865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:23.304828 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:23.304828 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:23.305045 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:23.305082 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:23.305096 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:23.305179 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:23.305308 (+ 129us) server_negotiation.cc:299] Negotiation successful
0806 00:57:23.305335 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":79,"threads_started":1}
I20260806 00:57:23.306591 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:23.312100 32602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:23.308130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.58:58361 (local address 127.0.0.1:40885)
0806 00:57:23.308164 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:23.308166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:23.308695 (+ 529us) server_negotiation.cc:407] Connection header received
0806 00:57:23.308757 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:23.308758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:23.308768 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:23.308823 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:23.308970 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:23.309715 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:23.310751 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:23.311071 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:23.311131 (+ 60us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:23.311848 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:23.311849 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:23.311850 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:23.311854 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:23.311868 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:23.311872 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:23.311927 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:23.312018 (+ 91us) server_negotiation.cc:299] Negotiation successful
0806 00:57:23.312030 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 00:57:23.320851 32594 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:23.321357 32594 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:23.324416 32594 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f8f0853d9e44e3186c2005ecf23e6c1: Generated new TSK 0
I20260806 00:57:23.324628 32594 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:23.329203 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 32492
W20260806 00:57:23.340623 32474 connection.cc:535] client connection to 127.0.0.1:40885 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40885): Connection reset by peer (error 104)
2026-08-06T00:57:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1540 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:23 dist-test-slave-44d2 krb5kdc[32627](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:23 dist-test-slave-44d2 krb5kdc[32627](info): set up 2 sockets
Aug 06 00:57:23 dist-test-slave-44d2 krb5kdc[32627](info): commencing operation
krb5kdc: starting...
W20260806 00:57:24.571395 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:24 dist-test-slave-44d2 krb5kdc[32627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 00:57:24.697467 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36555
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:24.782287 32647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:24.782500 32647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:24.782524 32647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:24.783619 32647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:24.783656 32647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:24.783671 32647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:24.783684 32647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:24.783696 32647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:24.785149 32647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36555
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:24.785349 32647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:24.785524 32647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:24.790699 32654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:24.790906 32647 server_base.cc:1034] running on GCE node
W20260806 00:57:24.790661 32658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:24.790683 32656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:24.791326 32647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:24.791603 32647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:24.792747 32647 hybrid_clock.cc:648] HybridClock initialized: now 1785977844792713 us; error 53 us; skew 500 ppm
Aug 06 00:57:24 dist-test-slave-44d2 krb5kdc[32627](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977844, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:24.795213 32647 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 00:57:24.795674 32647 webserver.cc:460] Webserver started at http://127.0.0.1:40733/ using document root <none> and password file <none>
I20260806 00:57:24.795881 32647 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:24.795921 32647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:24.796012 32647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:24.797115 32647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "005d8078a3cb44a9885a894bd7b765c7"
format_stamp: "Formatted at 2026-08-06 00:57:24 on dist-test-slave-44d2"
server_key: "e627d844f01e78320de9fdb75a775201"
server_key_iv: "5cf53212c6a84663ad2aa8630c73aae9"
server_key_version: "encryptionkey@0"
I20260806 00:57:24.797425 32647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "005d8078a3cb44a9885a894bd7b765c7"
format_stamp: "Formatted at 2026-08-06 00:57:24 on dist-test-slave-44d2"
server_key: "e627d844f01e78320de9fdb75a775201"
server_key_iv: "5cf53212c6a84663ad2aa8630c73aae9"
server_key_version: "encryptionkey@0"
I20260806 00:57:24.798799 32647 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:57:24.799520 32666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:24.799755 32647 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:24.799834 32647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "005d8078a3cb44a9885a894bd7b765c7"
format_stamp: "Formatted at 2026-08-06 00:57:24 on dist-test-slave-44d2"
server_key: "e627d844f01e78320de9fdb75a775201"
server_key_iv: "5cf53212c6a84663ad2aa8630c73aae9"
server_key_version: "encryptionkey@0"
I20260806 00:57:24.799921 32647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:24.803375 32647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:24.805398 32647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:24.805539 32647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:24.809754 32647 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36555
I20260806 00:57:24.809809 32739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36555 every 8 connection(s)
I20260806 00:57:24.810148 32647 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:24.811105 32741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:24.812474 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 32647
I20260806 00:57:24.812674 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:24.812863 3466 external_mini_cluster.cc:1428] Setting key cc0df26eda34521827c3d79d705d782b
I20260806 00:57:24.813817 32741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7: Bootstrap starting.
I20260806 00:57:24.814553 32741 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:24.814885 32741 log.cc:824] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:24.815380 32744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:24.813378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.58:46663 (local address 127.0.0.1:36555)
0806 00:57:24.813557 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:24.813565 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:24.813593 (+ 28us) server_negotiation.cc:407] Connection header received
0806 00:57:24.814043 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:24.814050 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:24.814083 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:24.814198 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:24.814919 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:24.814924 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:24.814924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:24.814943 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:24.814988 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:24.815001 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:24.815118 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:24.815176 (+ 58us) server_negotiation.cc:299] Negotiation successful
0806 00:57:24.815228 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":90,"threads_started":1}
I20260806 00:57:24.815748 32741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7: No bootstrap required, opened a new log
I20260806 00:57:24.816504 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:24.818048 32741 raft_consensus.cc:348] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005d8078a3cb44a9885a894bd7b765c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36555 } }
I20260806 00:57:24.818255 32741 raft_consensus.cc:374] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:24.818310 32741 raft_consensus.cc:729] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005d8078a3cb44a9885a894bd7b765c7, State: Initialized, Role: FOLLOWER
I20260806 00:57:24.818451 32741 consensus_queue.cc:260] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005d8078a3cb44a9885a894bd7b765c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36555 } }
I20260806 00:57:24.818562 32741 raft_consensus.cc:388] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:24.818610 32741 raft_consensus.cc:482] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:24.818663 32741 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:24.819021 32744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:24.818110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.58:41453 (local address 127.0.0.1:36555)
0806 00:57:24.818162 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:24.818164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:24.818171 (+ 7us) server_negotiation.cc:407] Connection header received
0806 00:57:24.818189 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:24.818190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:24.818194 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:24.818241 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:24.818793 (+ 552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:24.818794 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:24.818794 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:24.818799 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:24.818812 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:24.818816 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:24.818871 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:24.818927 (+ 56us) server_negotiation.cc:299] Negotiation successful
0806 00:57:24.818942 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 00:57:24.819432 32741 raft_consensus.cc:504] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005d8078a3cb44a9885a894bd7b765c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36555 } }
I20260806 00:57:24.819542 32741 leader_election.cc:302] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 005d8078a3cb44a9885a894bd7b765c7; no voters:
I20260806 00:57:24.819705 32741 leader_election.cc:288] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:24.819752 32755 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:24.819917 32755 raft_consensus.cc:686] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [term 1 LEADER]: Becoming Leader. State: Replica: 005d8078a3cb44a9885a894bd7b765c7, State: Running, Role: LEADER
I20260806 00:57:24.819958 32741 sys_catalog.cc:564] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:24.820066 32755 consensus_queue.cc:237] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005d8078a3cb44a9885a894bd7b765c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36555 } }
I20260806 00:57:24.820428 32756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "005d8078a3cb44a9885a894bd7b765c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005d8078a3cb44a9885a894bd7b765c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36555 } } }
I20260806 00:57:24.820437 32758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 005d8078a3cb44a9885a894bd7b765c7. Latest consensus state: current_term: 1 leader_uuid: "005d8078a3cb44a9885a894bd7b765c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005d8078a3cb44a9885a894bd7b765c7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36555 } } }
I20260806 00:57:24.820582 32756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:24.820604 32758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:24.820822 32765 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:24.821404 32765 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:24.823033 32765 catalog_manager.cc:1347] Generated new cluster ID: d3876d23313546cdb1621e3078ce2bb7
I20260806 00:57:24.823094 32765 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:24.828312 32765 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:24.828464 32765 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:24.831204 32765 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 005d8078a3cb44a9885a894bd7b765c7: Generated new TSK 0
I20260806 00:57:24.831379 32765 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:24.833124 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 32647
2026-08-06T00:57:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1505 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:24 dist-test-slave-44d2 krb5kdc[316](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:24 dist-test-slave-44d2 krb5kdc[316](info): set up 2 sockets
Aug 06 00:57:24 dist-test-slave-44d2 krb5kdc[316](info): commencing operation
krb5kdc: starting...
W20260806 00:57:26.063956 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.204s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:26 dist-test-slave-44d2 krb5kdc[316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 00:57:26.191257 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35135
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35135
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:26.275363 331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:26.275568 331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:26.275592 331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:26.276829 331 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:26.276875 331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:26.276889 331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:26.276934 331 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:26.276968 331 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:26.278427 331 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35135
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:26.278676 331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:26.278913 331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:26.283938 346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:26.283953 340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:26.283939 339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:26.284344 331 server_base.cc:1034] running on GCE node
I20260806 00:57:26.284627 331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:26.284919 331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:26.286090 331 hybrid_clock.cc:648] HybridClock initialized: now 1785977846286075 us; error 43 us; skew 500 ppm
Aug 06 00:57:26 dist-test-slave-44d2 krb5kdc[316](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977846, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:26.288626 331 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 00:57:26.289065 331 webserver.cc:460] Webserver started at http://127.0.0.1:43913/ using document root <none> and password file <none>
I20260806 00:57:26.289321 331 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:26.289392 331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:26.289544 331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:26.290632 331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "2510a444683e410d8f59db226928fa20"
format_stamp: "Formatted at 2026-08-06 00:57:26 on dist-test-slave-44d2"
server_key: "2ed0aa6bfb896f3a6247873f2c763970"
server_key_iv: "2f00cb3bbc12c5885f4b48d2117ac52e"
server_key_version: "encryptionkey@0"
I20260806 00:57:26.291003 331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "2510a444683e410d8f59db226928fa20"
format_stamp: "Formatted at 2026-08-06 00:57:26 on dist-test-slave-44d2"
server_key: "2ed0aa6bfb896f3a6247873f2c763970"
server_key_iv: "2f00cb3bbc12c5885f4b48d2117ac52e"
server_key_version: "encryptionkey@0"
I20260806 00:57:26.292366 331 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:26.293190 355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:26.293370 331 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:57:26.293464 331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "2510a444683e410d8f59db226928fa20"
format_stamp: "Formatted at 2026-08-06 00:57:26 on dist-test-slave-44d2"
server_key: "2ed0aa6bfb896f3a6247873f2c763970"
server_key_iv: "2f00cb3bbc12c5885f4b48d2117ac52e"
server_key_version: "encryptionkey@0"
I20260806 00:57:26.293550 331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:26.314325 331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:26.316404 331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:26.316617 331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:26.321071 331 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35135
I20260806 00:57:26.321139 421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35135 every 8 connection(s)
I20260806 00:57:26.321586 331 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:26.322646 422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:26.325038 422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20: Bootstrap starting.
I20260806 00:57:26.325676 422 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:26.325974 422 log.cc:824] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:26.326633 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 331
I20260806 00:57:26.326766 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:26.326822 422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20: No bootstrap required, opened a new log
I20260806 00:57:26.326982 3466 external_mini_cluster.cc:1428] Setting key 04fa8041d1a34510486dad15065c135a
I20260806 00:57:26.329332 422 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2510a444683e410d8f59db226928fa20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35135 } }
I20260806 00:57:26.329493 422 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:26.329546 422 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2510a444683e410d8f59db226928fa20, State: Initialized, Role: FOLLOWER
I20260806 00:57:26.329738 422 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2510a444683e410d8f59db226928fa20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35135 } }
I20260806 00:57:26.329838 422 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:26.329885 422 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:26.329936 422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:26.330487 422 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2510a444683e410d8f59db226928fa20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35135 } }
I20260806 00:57:26.330616 422 leader_election.cc:302] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2510a444683e410d8f59db226928fa20; no voters:
I20260806 00:57:26.330809 422 leader_election.cc:288] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:26.330843 428 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:26.330950 428 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [term 1 LEADER]: Becoming Leader. State: Replica: 2510a444683e410d8f59db226928fa20, State: Running, Role: LEADER
I20260806 00:57:26.331080 422 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:26.331103 428 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2510a444683e410d8f59db226928fa20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35135 } }
I20260806 00:57:26.331444 428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2510a444683e410d8f59db226928fa20. Latest consensus state: current_term: 1 leader_uuid: "2510a444683e410d8f59db226928fa20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2510a444683e410d8f59db226928fa20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35135 } } }
I20260806 00:57:26.331458 429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2510a444683e410d8f59db226928fa20" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2510a444683e410d8f59db226928fa20" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35135 } } }
I20260806 00:57:26.331617 428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:26.331707 429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:26.332643 437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:26.333253 437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 06 00:57:26 dist-test-slave-44d2 krb5kdc[316](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 00:57:26.335311 437 catalog_manager.cc:1347] Generated new cluster ID: b89f032e620749ca8245ad64f8f48766
I20260806 00:57:26.335371 437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:26.339601 426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:26.327530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.58:48937 (local address 127.0.0.1:35135)
0806 00:57:26.327711 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:26.327721 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:26.327756 (+ 35us) server_negotiation.cc:407] Connection header received
0806 00:57:26.328226 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:26.328233 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:26.328281 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:26.328393 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:26.329249 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:26.330552 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:26.331632 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:26.332179 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:26.332294 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:26.335375 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:26.335378 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:26.335379 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:26.335391 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:26.337395 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:26.338016 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:26.338021 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:26.338021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:26.338137 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:26.338415 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:26.338416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:26.338416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:26.338737 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:26.338890 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:26.339298 (+ 408us) server_negotiation.cc:299] Negotiation successful
0806 00:57:26.339394 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":84,"threads_started":1}
I20260806 00:57:26.340746 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:26.351856 426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:26.342311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.58:48881 (local address 127.0.0.1:35135)
0806 00:57:26.342353 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:26.342355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:26.344657 (+ 2302us) server_negotiation.cc:407] Connection header received
0806 00:57:26.344690 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:26.344691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:26.344702 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:26.344775 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:26.345346 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:26.346121 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:26.347103 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:26.347458 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:26.347541 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:26.348954 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:26.348956 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:26.348956 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:26.348963 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:26.350611 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:26.351031 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:26.351033 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:26.351033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:26.351096 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:26.351326 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:26.351327 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:26.351327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:26.351461 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:26.351576 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:26.351689 (+ 113us) server_negotiation.cc:299] Negotiation successful
0806 00:57:26.351757 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":20}
I20260806 00:57:26.354645 437 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:26.355881 437 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:26.369419 437 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2510a444683e410d8f59db226928fa20: Generated new TSK 0
I20260806 00:57:26.369671 437 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:26.377771 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 331
W20260806 00:57:26.390102 314 connection.cc:535] client connection to 127.0.0.1:35135 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35135): Connection reset by peer (error 104)
2026-08-06T00:57:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1544 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:26 dist-test-slave-44d2 krb5kdc[460](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:26 dist-test-slave-44d2 krb5kdc[460](info): set up 2 sockets
Aug 06 00:57:26 dist-test-slave-44d2 krb5kdc[460](info): commencing operation
krb5kdc: starting...
W20260806 00:57:27.581280 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:27 dist-test-slave-44d2 krb5kdc[460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 00:57:27.707978 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38025
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:27.806973 474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:27.807217 474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:27.807257 474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:27.808446 474 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:27.808533 474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:27.808558 474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:27.808584 474 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:27.808612 474 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:27.810135 474 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38025
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:27.810428 474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:27.810669 474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:27.815680 479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:27.815687 485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:27.815796 474 server_base.cc:1034] running on GCE node
W20260806 00:57:27.815687 482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:27.816246 474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:27.816623 474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:27.817807 474 hybrid_clock.cc:648] HybridClock initialized: now 1785977847817801 us; error 38 us; skew 500 ppm
Aug 06 00:57:27 dist-test-slave-44d2 krb5kdc[460](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977847, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:27.820393 474 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 00:57:27.820869 474 webserver.cc:460] Webserver started at http://127.0.0.1:45467/ using document root <none> and password file <none>
I20260806 00:57:27.821084 474 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:27.821127 474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:27.821221 474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:27.822281 474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "54b1728ce2ba40569e2d773124181a6f"
format_stamp: "Formatted at 2026-08-06 00:57:27 on dist-test-slave-44d2"
server_key: "47bd7701dffcddd51c54dfdb823b7402"
server_key_iv: "67c7ca5aa27e2411aecf5de4f6a0ebc2"
server_key_version: "encryptionkey@0"
I20260806 00:57:27.822614 474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "54b1728ce2ba40569e2d773124181a6f"
format_stamp: "Formatted at 2026-08-06 00:57:27 on dist-test-slave-44d2"
server_key: "47bd7701dffcddd51c54dfdb823b7402"
server_key_iv: "67c7ca5aa27e2411aecf5de4f6a0ebc2"
server_key_version: "encryptionkey@0"
I20260806 00:57:27.823973 474 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:57:27.824712 497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:27.824903 474 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:57:27.824985 474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "54b1728ce2ba40569e2d773124181a6f"
format_stamp: "Formatted at 2026-08-06 00:57:27 on dist-test-slave-44d2"
server_key: "47bd7701dffcddd51c54dfdb823b7402"
server_key_iv: "67c7ca5aa27e2411aecf5de4f6a0ebc2"
server_key_version: "encryptionkey@0"
I20260806 00:57:27.825042 474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:27.831859 474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:27.834286 474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:27.834398 474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:27.838370 474 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38025
I20260806 00:57:27.838433 576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38025 every 8 connection(s)
I20260806 00:57:27.838778 474 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:27.839692 577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:27.842067 577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f: Bootstrap starting.
I20260806 00:57:27.842649 577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:27.842944 577 log.cc:824] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:27.843573 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 474
I20260806 00:57:27.843721 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:27.843782 577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f: No bootstrap required, opened a new log
I20260806 00:57:27.843936 3466 external_mini_cluster.cc:1428] Setting key 6d975d2bf5d6f7ff367ef5f1a8115e28
I20260806 00:57:27.845789 577 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54b1728ce2ba40569e2d773124181a6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38025 } }
I20260806 00:57:27.845963 577 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:27.846004 577 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54b1728ce2ba40569e2d773124181a6f, State: Initialized, Role: FOLLOWER
I20260806 00:57:27.846158 577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54b1728ce2ba40569e2d773124181a6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38025 } }
I20260806 00:57:27.846279 577 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:27.846328 577 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:27.846402 577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:27.846968 577 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54b1728ce2ba40569e2d773124181a6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38025 } }
I20260806 00:57:27.847098 577 leader_election.cc:302] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54b1728ce2ba40569e2d773124181a6f; no voters:
I20260806 00:57:27.847293 577 leader_election.cc:288] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:27.847316 585 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:27.847438 585 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [term 1 LEADER]: Becoming Leader. State: Replica: 54b1728ce2ba40569e2d773124181a6f, State: Running, Role: LEADER
I20260806 00:57:27.847568 577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:27.847596 585 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54b1728ce2ba40569e2d773124181a6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38025 } }
I20260806 00:57:27.848034 585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54b1728ce2ba40569e2d773124181a6f. Latest consensus state: current_term: 1 leader_uuid: "54b1728ce2ba40569e2d773124181a6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54b1728ce2ba40569e2d773124181a6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38025 } } }
I20260806 00:57:27.848189 585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:27.848452 595 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:27.849117 595 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:27.849151 587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54b1728ce2ba40569e2d773124181a6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54b1728ce2ba40569e2d773124181a6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38025 } } }
I20260806 00:57:27.849303 587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:27.850951 595 catalog_manager.cc:1347] Generated new cluster ID: 57b554801f044621ac901226aa6a77a9
I20260806 00:57:27.851006 595 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:27.851295 584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:27.844456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.58:40497 (local address 127.0.0.1:38025)
0806 00:57:27.844690 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:27.844698 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:27.844783 (+ 85us) server_negotiation.cc:407] Connection header received
0806 00:57:27.845773 (+ 990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:27.845780 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:27.845829 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:27.845946 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:27.846226 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:27.847743 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:27.848927 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:27.849558 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:27.849704 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:27.850460 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:27.850464 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:27.850464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:27.850682 (+ 218us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:27.850728 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:27.850744 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:27.850827 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:27.851105 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 00:57:27.851140 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":118,"threads_started":1}
I20260806 00:57:27.852269 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:27.859766 584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:27.856808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.58:33523 (local address 127.0.0.1:38025)
0806 00:57:27.856858 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:27.856859 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:27.856994 (+ 135us) server_negotiation.cc:407] Connection header received
0806 00:57:27.857076 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:27.857076 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:27.857088 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:27.857144 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:27.857304 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:27.857763 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:27.858501 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:27.858730 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:27.858805 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:27.859531 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:27.859533 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:27.859533 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:27.859538 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:27.859552 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:27.859556 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:27.859611 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:27.859672 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 00:57:27.859684 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 00:57:27.860673 595 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:27.861146 595 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:27.865375 595 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54b1728ce2ba40569e2d773124181a6f: Generated new TSK 0
I20260806 00:57:27.865568 595 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:27.870337 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 474
W20260806 00:57:27.882457 457 connection.cc:535] client connection to 127.0.0.1:38025 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38025): Connection reset by peer (error 104)
2026-08-06T00:57:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1492 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:27 dist-test-slave-44d2 krb5kdc[623](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:27 dist-test-slave-44d2 krb5kdc[623](info): set up 2 sockets
Aug 06 00:57:27 dist-test-slave-44d2 krb5kdc[623](info): commencing operation
krb5kdc: starting...
W20260806 00:57:29.135370 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:29 dist-test-slave-44d2 krb5kdc[623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 00:57:29.263813 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33669
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33669
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:29.347244 639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:29.347486 639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:29.347524 639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:29.348738 639 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:29.348814 639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:29.348838 639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:29.348860 639 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:29.348889 639 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:29.350373 639 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33669
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:29.350670 639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:29.350904 639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:29.355865 646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:29.355904 649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:29.356027 647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:29.356120 639 server_base.cc:1034] running on GCE node
I20260806 00:57:29.356354 639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:29.356662 639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:29.357807 639 hybrid_clock.cc:648] HybridClock initialized: now 1785977849357794 us; error 30 us; skew 500 ppm
Aug 06 00:57:29 dist-test-slave-44d2 krb5kdc[623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977849, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:29.366680 639 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 00:57:29.367164 639 webserver.cc:460] Webserver started at http://127.0.0.1:38319/ using document root <none> and password file <none>
I20260806 00:57:29.367393 639 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:29.367462 639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:29.367623 639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:29.368779 639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "eae3ae06714e49288ce9856b88e7df65"
format_stamp: "Formatted at 2026-08-06 00:57:29 on dist-test-slave-44d2"
server_key: "8cfb6d8ed4584b3b1fe34965c2a0ee8b"
server_key_iv: "2c8fac07130086ba6613026b4afbb17a"
server_key_version: "encryptionkey@0"
I20260806 00:57:29.369153 639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "eae3ae06714e49288ce9856b88e7df65"
format_stamp: "Formatted at 2026-08-06 00:57:29 on dist-test-slave-44d2"
server_key: "8cfb6d8ed4584b3b1fe34965c2a0ee8b"
server_key_iv: "2c8fac07130086ba6613026b4afbb17a"
server_key_version: "encryptionkey@0"
I20260806 00:57:29.370498 639 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:57:29.371248 660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:29.371420 639 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:29.371529 639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "eae3ae06714e49288ce9856b88e7df65"
format_stamp: "Formatted at 2026-08-06 00:57:29 on dist-test-slave-44d2"
server_key: "8cfb6d8ed4584b3b1fe34965c2a0ee8b"
server_key_iv: "2c8fac07130086ba6613026b4afbb17a"
server_key_version: "encryptionkey@0"
I20260806 00:57:29.371620 639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:29.374989 639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:29.377669 639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:29.377842 639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:29.382022 639 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33669
I20260806 00:57:29.382061 731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33669 every 8 connection(s)
I20260806 00:57:29.382385 639 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:29.383229 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:29.385629 732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65: Bootstrap starting.
I20260806 00:57:29.386215 732 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:29.386538 732 log.cc:824] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:29.387284 732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65: No bootstrap required, opened a new log
I20260806 00:57:29.389074 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 639
I20260806 00:57:29.389204 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:29.389071 732 raft_consensus.cc:348] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae3ae06714e49288ce9856b88e7df65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33669 } }
I20260806 00:57:29.389245 732 raft_consensus.cc:374] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:29.389281 732 raft_consensus.cc:729] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eae3ae06714e49288ce9856b88e7df65, State: Initialized, Role: FOLLOWER
I20260806 00:57:29.389428 3466 external_mini_cluster.cc:1428] Setting key a6d147a4fe72611135c9634fe88ac4a1
I20260806 00:57:29.389437 732 consensus_queue.cc:260] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae3ae06714e49288ce9856b88e7df65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33669 } }
I20260806 00:57:29.389533 732 raft_consensus.cc:388] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:29.389575 732 raft_consensus.cc:482] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:29.389633 732 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:29.390784 732 raft_consensus.cc:504] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae3ae06714e49288ce9856b88e7df65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33669 } }
I20260806 00:57:29.390913 732 leader_election.cc:302] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eae3ae06714e49288ce9856b88e7df65; no voters:
I20260806 00:57:29.391086 732 leader_election.cc:288] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:29.391125 738 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:29.391320 738 raft_consensus.cc:686] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [term 1 LEADER]: Becoming Leader. State: Replica: eae3ae06714e49288ce9856b88e7df65, State: Running, Role: LEADER
I20260806 00:57:29.391351 732 sys_catalog.cc:564] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:29.391472 738 consensus_queue.cc:237] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae3ae06714e49288ce9856b88e7df65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33669 } }
I20260806 00:57:29.391839 737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:29.389953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.58:36221 (local address 127.0.0.1:33669)
0806 00:57:29.390147 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:29.390156 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:29.390189 (+ 33us) server_negotiation.cc:407] Connection header received
0806 00:57:29.390298 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:29.390303 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:29.390335 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:29.390447 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:29.391119 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:29.391123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:29.391124 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:29.391128 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:29.391184 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:29.391200 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:29.391435 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:29.391467 (+ 32us) server_negotiation.cc:299] Negotiation successful
0806 00:57:29.391509 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":130,"threads_started":1}
I20260806 00:57:29.392143 739 sys_catalog.cc:455] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eae3ae06714e49288ce9856b88e7df65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae3ae06714e49288ce9856b88e7df65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33669 } } }
I20260806 00:57:29.392359 739 sys_catalog.cc:458] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:29.392709 750 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:29.392830 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:29.393131 740 sys_catalog.cc:455] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eae3ae06714e49288ce9856b88e7df65. Latest consensus state: current_term: 1 leader_uuid: "eae3ae06714e49288ce9856b88e7df65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eae3ae06714e49288ce9856b88e7df65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33669 } } }
I20260806 00:57:29.393270 740 sys_catalog.cc:458] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:29.393311 750 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:29.395898 750 catalog_manager.cc:1347] Generated new cluster ID: 368bee4f13a743578878dae25cd6bf5f
I20260806 00:57:29.395983 750 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:29.396085 737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:29.394596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.58:48887 (local address 127.0.0.1:33669)
0806 00:57:29.394659 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:29.394661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:29.394905 (+ 244us) server_negotiation.cc:407] Connection header received
0806 00:57:29.394999 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:29.395000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:29.395006 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:29.395069 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:29.395752 (+ 683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:29.395754 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:29.395754 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:29.395759 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:29.395776 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:29.395781 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:29.395842 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:29.396015 (+ 173us) server_negotiation.cc:299] Negotiation successful
0806 00:57:29.396028 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 00:57:29.410115 750 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:29.410313 750 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:29.414736 750 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eae3ae06714e49288ce9856b88e7df65: Generated new TSK 0
I20260806 00:57:29.414925 750 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:29.417457 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 639
2026-08-06T00:57:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1548 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:29 dist-test-slave-44d2 krb5kdc[775](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:29 dist-test-slave-44d2 krb5kdc[775](info): set up 2 sockets
Aug 06 00:57:29 dist-test-slave-44d2 krb5kdc[775](info): commencing operation
krb5kdc: starting...
W20260806 00:57:30.654788 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:30 dist-test-slave-44d2 krb5kdc[775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:57:30.775549 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:36679
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:36679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:30.858537 791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:30.858794 791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:30.858856 791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:30.860062 791 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:30.860136 791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:30.860164 791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:30.860189 791 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:30.860220 791 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:30.861745 791 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:36679
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:36679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:30.862022 791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:30.862285 791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:30.867393 799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:30.867436 798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:30.867393 801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:30.867744 791 server_base.cc:1034] running on GCE node
I20260806 00:57:30.867995 791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:30.868300 791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:30.869460 791 hybrid_clock.cc:648] HybridClock initialized: now 1785977850869438 us; error 34 us; skew 500 ppm
Aug 06 00:57:30 dist-test-slave-44d2 krb5kdc[775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977850, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:30.871873 791 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:57:30.872316 791 webserver.cc:460] Webserver started at http://127.3.98.190:33653/ using document root <none> and password file <none>
I20260806 00:57:30.872625 791 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:30.872697 791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:30.872853 791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:30.873907 791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "4ed6efa8ed204c82ba2896041007786c"
format_stamp: "Formatted at 2026-08-06 00:57:30 on dist-test-slave-44d2"
server_key: "484b45901acf236a6719b5a892f8e91a"
server_key_iv: "3da04614ba924c6a61891e4d83475eca"
server_key_version: "encryptionkey@0"
I20260806 00:57:30.874285 791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "4ed6efa8ed204c82ba2896041007786c"
format_stamp: "Formatted at 2026-08-06 00:57:30 on dist-test-slave-44d2"
server_key: "484b45901acf236a6719b5a892f8e91a"
server_key_iv: "3da04614ba924c6a61891e4d83475eca"
server_key_version: "encryptionkey@0"
I20260806 00:57:30.875720 791 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:57:30.876577 809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:30.876767 791 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:57:30.876869 791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "4ed6efa8ed204c82ba2896041007786c"
format_stamp: "Formatted at 2026-08-06 00:57:30 on dist-test-slave-44d2"
server_key: "484b45901acf236a6719b5a892f8e91a"
server_key_iv: "3da04614ba924c6a61891e4d83475eca"
server_key_version: "encryptionkey@0"
I20260806 00:57:30.876957 791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:30.911484 791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:30.913561 791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:30.913745 791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:30.918428 791 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:36679
I20260806 00:57:30.918463 881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:36679 every 8 connection(s)
I20260806 00:57:30.918876 791 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:30.919806 883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:30.920975 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 791
I20260806 00:57:30.921136 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:30.921346 3466 external_mini_cluster.cc:1428] Setting key 62616fba30e509404d339f82b8d2c330
I20260806 00:57:30.922436 883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c: Bootstrap starting.
I20260806 00:57:30.923206 883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:30.923578 883 log.cc:824] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:30.924324 883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c: No bootstrap required, opened a new log
I20260806 00:57:30.926740 883 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed6efa8ed204c82ba2896041007786c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36679 } }
I20260806 00:57:30.926937 883 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:30.926983 883 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ed6efa8ed204c82ba2896041007786c, State: Initialized, Role: FOLLOWER
I20260806 00:57:30.927130 883 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed6efa8ed204c82ba2896041007786c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36679 } }
I20260806 00:57:30.927222 883 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:30.927256 883 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:30.927315 883 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:30.928112 883 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed6efa8ed204c82ba2896041007786c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36679 } }
I20260806 00:57:30.928203 883 leader_election.cc:302] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ed6efa8ed204c82ba2896041007786c; no voters:
I20260806 00:57:30.928422 883 leader_election.cc:288] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:30.928447 890 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:30.928575 890 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [term 1 LEADER]: Becoming Leader. State: Replica: 4ed6efa8ed204c82ba2896041007786c, State: Running, Role: LEADER
I20260806 00:57:30.928661 890 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed6efa8ed204c82ba2896041007786c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36679 } }
Aug 06 00:57:30 dist-test-slave-44d2 krb5kdc[775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977850, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:30.928742 883 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:30.928985 890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ed6efa8ed204c82ba2896041007786c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed6efa8ed204c82ba2896041007786c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36679 } } }
I20260806 00:57:30.929141 890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:30.929352 890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ed6efa8ed204c82ba2896041007786c. Latest consensus state: current_term: 1 leader_uuid: "4ed6efa8ed204c82ba2896041007786c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed6efa8ed204c82ba2896041007786c" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 36679 } } }
I20260806 00:57:30.929462 890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:30.930151 900 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:30.930754 900 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:30.933369 887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:30.921936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33677 (local address 127.3.98.190:36679)
0806 00:57:30.922138 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:30.922146 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:30.922172 (+ 26us) server_negotiation.cc:407] Connection header received
0806 00:57:30.922624 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:30.922632 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:30.922681 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:30.922799 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:30.923726 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:30.924751 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:30.925835 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:30.926234 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:30.926315 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:30.929390 (+ 3075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:30.929394 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:30.929394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:30.929407 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:30.931653 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:30.932131 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:30.932134 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:30.932135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:30.932233 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:30.932499 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:30.932500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:30.932501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:30.932757 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:30.932947 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:30.933073 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 00:57:30.933178 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":112,"threads_started":1}
I20260806 00:57:30.934398 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:30.936911 900 catalog_manager.cc:1347] Generated new cluster ID: d5400ba4c2a24203b0bf35e7ba0ba919
I20260806 00:57:30.936964 900 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:30.943152 887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:30.935753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45805 (local address 127.3.98.190:36679)
0806 00:57:30.935793 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:30.935795 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:30.935847 (+ 52us) server_negotiation.cc:407] Connection header received
0806 00:57:30.935919 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:30.935920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:30.935929 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:30.935992 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:30.936448 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:30.937580 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:30.938564 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:30.938881 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:30.938957 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:30.940281 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:30.940282 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:30.940282 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:30.940290 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:30.941907 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:30.942332 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:30.942333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:30.942333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:30.942395 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:30.942630 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:30.942631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:30.942631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:30.942763 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:30.942871 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:30.942985 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 00:57:30.943060 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 00:57:30.955415 900 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:30.956146 900 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:30.972676 900 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ed6efa8ed204c82ba2896041007786c: Generated new TSK 0
I20260806 00:57:30.972925 900 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:30.977336 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 791
W20260806 00:57:30.988193 770 connection.cc:535] client connection to 127.3.98.190:36679 recv error: Network error: failed to read from TLS socket (remote: 127.3.98.190:36679): Connection reset by peer (error 104)
2026-08-06T00:57:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1556 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:31 dist-test-slave-44d2 krb5kdc[922](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:31 dist-test-slave-44d2 krb5kdc[922](info): set up 2 sockets
Aug 06 00:57:31 dist-test-slave-44d2 krb5kdc[922](info): commencing operation
krb5kdc: starting...
W20260806 00:57:32.275580 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:32 dist-test-slave-44d2 krb5kdc[922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:57:32.401108 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:33559
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:33559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:32.486164 941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:32.486366 941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:32.486393 941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:32.487551 941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:32.487599 941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:32.487613 941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:32.487660 941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:32.487686 941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:32.489238 941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:33559
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:33559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:32.489498 941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:32.489740 941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:32.494820 948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:32.494860 950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:32.494853 954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:32.494993 941 server_base.cc:1034] running on GCE node
I20260806 00:57:32.495260 941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:32.495519 941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:32.496686 941 hybrid_clock.cc:648] HybridClock initialized: now 1785977852496681 us; error 39 us; skew 500 ppm
Aug 06 00:57:32 dist-test-slave-44d2 krb5kdc[922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977852, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:32.499154 941 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:57:32.499589 941 webserver.cc:460] Webserver started at http://127.3.98.190:43485/ using document root <none> and password file <none>
I20260806 00:57:32.499845 941 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:32.499912 941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:32.500056 941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:32.501210 941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "e4c0e495f3694be5aa58038b2be3d705"
format_stamp: "Formatted at 2026-08-06 00:57:32 on dist-test-slave-44d2"
server_key: "a53e71d8671d85990c633e3031f33b86"
server_key_iv: "a4457ac0140d646c7d367725242a5c96"
server_key_version: "encryptionkey@0"
I20260806 00:57:32.501621 941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "e4c0e495f3694be5aa58038b2be3d705"
format_stamp: "Formatted at 2026-08-06 00:57:32 on dist-test-slave-44d2"
server_key: "a53e71d8671d85990c633e3031f33b86"
server_key_iv: "a4457ac0140d646c7d367725242a5c96"
server_key_version: "encryptionkey@0"
I20260806 00:57:32.502979 941 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:57:32.503692 961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:32.503866 941 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:32.503973 941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "e4c0e495f3694be5aa58038b2be3d705"
format_stamp: "Formatted at 2026-08-06 00:57:32 on dist-test-slave-44d2"
server_key: "a53e71d8671d85990c633e3031f33b86"
server_key_iv: "a4457ac0140d646c7d367725242a5c96"
server_key_version: "encryptionkey@0"
I20260806 00:57:32.504046 941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:32.526122 941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:32.528640 941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:32.528815 941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:32.532905 941 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:33559
I20260806 00:57:32.532943 1026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:33559 every 8 connection(s)
I20260806 00:57:32.533326 941 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:32.534237 1027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:32.536672 1027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705: Bootstrap starting.
I20260806 00:57:32.536685 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 941
I20260806 00:57:32.536815 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:32.537046 3466 external_mini_cluster.cc:1428] Setting key 8f145bf24d37afb32649141a1bd911ac
I20260806 00:57:32.537468 1027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:32.537884 1027 log.cc:824] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:32.538656 1027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705: No bootstrap required, opened a new log
I20260806 00:57:32.540823 1027 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4c0e495f3694be5aa58038b2be3d705" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 33559 } }
I20260806 00:57:32.541002 1027 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:32.541029 1027 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4c0e495f3694be5aa58038b2be3d705, State: Initialized, Role: FOLLOWER
I20260806 00:57:32.541185 1027 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4c0e495f3694be5aa58038b2be3d705" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 33559 } }
I20260806 00:57:32.541258 1027 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:32.541280 1027 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:32.541348 1027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:32.542104 1027 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4c0e495f3694be5aa58038b2be3d705" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 33559 } }
I20260806 00:57:32.542232 1027 leader_election.cc:302] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4c0e495f3694be5aa58038b2be3d705; no voters:
I20260806 00:57:32.542400 1027 leader_election.cc:288] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:32.542423 1040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:32.542549 1040 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [term 1 LEADER]: Becoming Leader. State: Replica: e4c0e495f3694be5aa58038b2be3d705, State: Running, Role: LEADER
I20260806 00:57:32.542685 1027 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:32.542702 1040 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4c0e495f3694be5aa58038b2be3d705" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 33559 } }
I20260806 00:57:32.543119 1044 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4c0e495f3694be5aa58038b2be3d705. Latest consensus state: current_term: 1 leader_uuid: "e4c0e495f3694be5aa58038b2be3d705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4c0e495f3694be5aa58038b2be3d705" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 33559 } } }
I20260806 00:57:32.543181 1036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:32.537617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38189 (local address 127.3.98.190:33559)
0806 00:57:32.537810 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:32.537818 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:32.537844 (+ 26us) server_negotiation.cc:407] Connection header received
0806 00:57:32.538337 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:32.538344 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:32.538393 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:32.538511 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:32.538793 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:32.539681 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:32.540877 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:32.541475 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:32.541572 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:32.542290 (+ 718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:32.542294 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:32.542295 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:32.542515 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:32.542561 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:32.542578 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:32.542867 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:32.542911 (+ 44us) server_negotiation.cc:299] Negotiation successful
0806 00:57:32.542936 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":87,"threads_started":1}
I20260806 00:57:32.543197 1044 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:32.543659 1041 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4c0e495f3694be5aa58038b2be3d705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4c0e495f3694be5aa58038b2be3d705" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 33559 } } }
I20260806 00:57:32.543776 1041 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:32.544023 1055 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:32.544102 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:32.544745 1055 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:32.546398 1055 catalog_manager.cc:1347] Generated new cluster ID: 97fc150d51d04f21a8dbc489988a4cfb
I20260806 00:57:32.546455 1055 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:32.549255 1036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:32.545663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33805 (local address 127.3.98.190:33559)
0806 00:57:32.545697 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:32.545699 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:32.545869 (+ 170us) server_negotiation.cc:407] Connection header received
0806 00:57:32.545929 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:32.545930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:32.545939 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:32.546000 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:32.546154 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:32.546865 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:32.547898 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:32.548197 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:32.548257 (+ 60us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:32.549005 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:32.549006 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:32.549006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:32.549010 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:32.549024 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:32.549028 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:32.549083 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:32.549178 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 00:57:32.549187 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 00:57:32.586175 1055 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:32.586795 1055 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:32.593250 1055 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4c0e495f3694be5aa58038b2be3d705: Generated new TSK 0
I20260806 00:57:32.593468 1055 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:32.606295 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 941
W20260806 00:57:32.617589 920 connection.cc:535] client connection to 127.3.98.190:33559 recv error: Network error: failed to read from TLS socket (remote: 127.3.98.190:33559): Connection reset by peer (error 104)
2026-08-06T00:57:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1629 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:32 dist-test-slave-44d2 krb5kdc[1078](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:32 dist-test-slave-44d2 krb5kdc[1078](info): set up 2 sockets
Aug 06 00:57:32 dist-test-slave-44d2 krb5kdc[1078](info): commencing operation
krb5kdc: starting...
W20260806 00:57:33.885041 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:33 dist-test-slave-44d2 krb5kdc[1078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:57:34.011662 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:40573
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:37825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:40573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:34.094353 1097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:34.094555 1097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:34.094579 1097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:34.095636 1097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:34.095671 1097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:34.095686 1097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:34.095700 1097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:34.095711 1097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:34.097128 1097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:37825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:40573
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:40573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:34.097321 1097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:34.097488 1097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:34.102581 1105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:34.102605 1102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:34.102531 1109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:34.102981 1097 server_base.cc:1034] running on GCE node
I20260806 00:57:34.103259 1097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:34.103579 1097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:34.104748 1097 hybrid_clock.cc:648] HybridClock initialized: now 1785977854104704 us; error 84 us; skew 500 ppm
Aug 06 00:57:34 dist-test-slave-44d2 krb5kdc[1078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977854, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:34.107363 1097 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:57:34.107825 1097 webserver.cc:460] Webserver started at http://127.3.98.190:45971/ using document root <none> and password file <none>
I20260806 00:57:34.108083 1097 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:34.108131 1097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:34.108276 1097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:34.109404 1097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "2067623df2de4ce094455ce742b6e978"
format_stamp: "Formatted at 2026-08-06 00:57:34 on dist-test-slave-44d2"
server_key: "9741d302b168240a7975ba5fad68fc6b"
server_key_iv: "2cdf9d5bf692c62c4bbd9eea0fde5a14"
server_key_version: "encryptionkey@0"
I20260806 00:57:34.109776 1097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "2067623df2de4ce094455ce742b6e978"
format_stamp: "Formatted at 2026-08-06 00:57:34 on dist-test-slave-44d2"
server_key: "9741d302b168240a7975ba5fad68fc6b"
server_key_iv: "2cdf9d5bf692c62c4bbd9eea0fde5a14"
server_key_version: "encryptionkey@0"
I20260806 00:57:34.111234 1097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 00:57:34.111994 1118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:34.112191 1097 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:57:34.112278 1097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "2067623df2de4ce094455ce742b6e978"
format_stamp: "Formatted at 2026-08-06 00:57:34 on dist-test-slave-44d2"
server_key: "9741d302b168240a7975ba5fad68fc6b"
server_key_iv: "2cdf9d5bf692c62c4bbd9eea0fde5a14"
server_key_version: "encryptionkey@0"
I20260806 00:57:34.112336 1097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:34.116294 1097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:34.118741 1097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:34.118852 1097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:34.122783 1097 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:40573
I20260806 00:57:34.122934 1192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:40573 every 8 connection(s)
I20260806 00:57:34.123194 1097 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:34.124272 1193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:34.126777 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 1097
I20260806 00:57:34.126883 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:34.126927 1193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978: Bootstrap starting.
I20260806 00:57:34.127120 3466 external_mini_cluster.cc:1428] Setting key bd6bf9289b420e20535f90758742d641
I20260806 00:57:34.127823 1193 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:34.128209 1193 log.cc:824] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:34.129112 1193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978: No bootstrap required, opened a new log
I20260806 00:57:34.130142 1196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:34.127680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50107 (local address 127.3.98.190:40573)
0806 00:57:34.127912 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:34.127923 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:34.127961 (+ 38us) server_negotiation.cc:407] Connection header received
0806 00:57:34.128708 (+ 747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:34.128743 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:34.128786 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:34.128962 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:34.129633 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:34.129637 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:34.129637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:34.129641 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:34.129679 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:34.129689 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:34.129760 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:34.129842 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 00:57:34.129873 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":86,"threads_started":1}
I20260806 00:57:34.131335 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:34.131925 1193 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2067623df2de4ce094455ce742b6e978" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40573 } }
I20260806 00:57:34.132069 1193 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:34.132094 1193 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2067623df2de4ce094455ce742b6e978, State: Initialized, Role: FOLLOWER
I20260806 00:57:34.132247 1193 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2067623df2de4ce094455ce742b6e978" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40573 } }
I20260806 00:57:34.132390 1193 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:34.132498 1193 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:34.132565 1193 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:34.133304 1193 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2067623df2de4ce094455ce742b6e978" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40573 } }
I20260806 00:57:34.133442 1193 leader_election.cc:302] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2067623df2de4ce094455ce742b6e978; no voters:
I20260806 00:57:34.133616 1193 leader_election.cc:288] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:34.133644 1204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:34.133770 1204 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [term 1 LEADER]: Becoming Leader. State: Replica: 2067623df2de4ce094455ce742b6e978, State: Running, Role: LEADER
I20260806 00:57:34.133893 1193 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:34.133945 1204 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2067623df2de4ce094455ce742b6e978" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40573 } }
I20260806 00:57:34.134037 1196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:34.132831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54093 (local address 127.3.98.190:40573)
0806 00:57:34.132864 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:34.132866 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:34.133024 (+ 158us) server_negotiation.cc:407] Connection header received
0806 00:57:34.133088 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:34.133089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:34.133095 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:34.133141 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:34.133742 (+ 601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:34.133743 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:34.133743 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:34.133748 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:34.133764 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:34.133769 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:34.133814 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:34.133940 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 00:57:34.133952 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260806 00:57:34.134507 1204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2067623df2de4ce094455ce742b6e978. Latest consensus state: current_term: 1 leader_uuid: "2067623df2de4ce094455ce742b6e978" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2067623df2de4ce094455ce742b6e978" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40573 } } }
I20260806 00:57:34.135646 1206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2067623df2de4ce094455ce742b6e978" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2067623df2de4ce094455ce742b6e978" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40573 } } }
I20260806 00:57:34.135746 1204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [sys.catalog]: This master's current role is: LEADER
W20260806 00:57:34.136085 1227 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260806 00:57:34.136111 1206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978 [sys.catalog]: This master's current role is: LEADER
W20260806 00:57:34.136164 1227 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:57:34.136392 1232 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:34.136616 1232 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:34.138190 1232 catalog_manager.cc:1347] Generated new cluster ID: 8d6984196e2d4fd591f0270add519902
I20260806 00:57:34.138268 1232 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:34.146319 1232 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:34.146517 1232 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:34.162503 1232 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2067623df2de4ce094455ce742b6e978: Generated new TSK 0
I20260806 00:57:34.162755 1232 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:34.164808 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 1097
2026-08-06T00:57:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1561 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:34 dist-test-slave-44d2 krb5kdc[1236](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:34 dist-test-slave-44d2 krb5kdc[1236](info): set up 2 sockets
Aug 06 00:57:34 dist-test-slave-44d2 krb5kdc[1236](info): commencing operation
krb5kdc: starting...
W20260806 00:57:35.469233 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:35 dist-test-slave-44d2 krb5kdc[1236](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:57:35.599448 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:34889
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:34889
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:35.682897 1251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:35.683174 1251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:35.683216 1251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:35.684383 1251 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:35.684468 1251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:35.684540 1251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:35.684571 1251 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:35.684592 1251 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:35.686110 1251 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:34889
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:34889
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:35.686404 1251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:35.686636 1251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:35.691613 1258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:35.691646 1259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:35.691581 1261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:35.691746 1251 server_base.cc:1034] running on GCE node
I20260806 00:57:35.692013 1251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:35.692271 1251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:35.693415 1251 hybrid_clock.cc:648] HybridClock initialized: now 1785977855693385 us; error 53 us; skew 500 ppm
Aug 06 00:57:35 dist-test-slave-44d2 krb5kdc[1236](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977855, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:35.696547 1251 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:57:35.696985 1251 webserver.cc:460] Webserver started at http://127.3.98.190:34157/ using document root <none> and password file <none>
I20260806 00:57:35.697237 1251 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:35.697284 1251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:35.697431 1251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:35.698493 1251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "6a86338554ab426ba9a4c519939aa92b"
format_stamp: "Formatted at 2026-08-06 00:57:35 on dist-test-slave-44d2"
server_key: "46683acd302ea7ce09952b007befb34a"
server_key_iv: "af3bac7636eaf4b2defdda1276939cf1"
server_key_version: "encryptionkey@0"
I20260806 00:57:35.698876 1251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "6a86338554ab426ba9a4c519939aa92b"
format_stamp: "Formatted at 2026-08-06 00:57:35 on dist-test-slave-44d2"
server_key: "46683acd302ea7ce09952b007befb34a"
server_key_iv: "af3bac7636eaf4b2defdda1276939cf1"
server_key_version: "encryptionkey@0"
I20260806 00:57:35.700269 1251 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:35.701092 1272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:35.701287 1251 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 00:57:35.701385 1251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "6a86338554ab426ba9a4c519939aa92b"
format_stamp: "Formatted at 2026-08-06 00:57:35 on dist-test-slave-44d2"
server_key: "46683acd302ea7ce09952b007befb34a"
server_key_iv: "af3bac7636eaf4b2defdda1276939cf1"
server_key_version: "encryptionkey@0"
I20260806 00:57:35.701459 1251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:35.728960 1251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:35.731454 1251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:35.731634 1251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:35.735832 1251 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:34889
I20260806 00:57:35.735893 1349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:34889 every 8 connection(s)
I20260806 00:57:35.736254 1251 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:35.737241 1352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:35.739610 1352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b: Bootstrap starting.
I20260806 00:57:35.740217 1352 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:35.740599 1352 log.cc:824] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:35.741358 1352 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b: No bootstrap required, opened a new log
I20260806 00:57:35.743012 1352 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a86338554ab426ba9a4c519939aa92b" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34889 } }
I20260806 00:57:35.743182 1352 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:35.743234 1352 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a86338554ab426ba9a4c519939aa92b, State: Initialized, Role: FOLLOWER
I20260806 00:57:35.743407 1352 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a86338554ab426ba9a4c519939aa92b" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34889 } }
I20260806 00:57:35.743510 1352 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:35.743554 1352 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:35.743615 1352 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:35.744648 1352 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a86338554ab426ba9a4c519939aa92b" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34889 } }
I20260806 00:57:35.744768 1352 leader_election.cc:302] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a86338554ab426ba9a4c519939aa92b; no voters:
I20260806 00:57:35.744935 1352 leader_election.cc:288] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:35.744961 1357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:35.745126 1357 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [term 1 LEADER]: Becoming Leader. State: Replica: 6a86338554ab426ba9a4c519939aa92b, State: Running, Role: LEADER
I20260806 00:57:35.745201 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 1251
I20260806 00:57:35.745347 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:35.745198 1352 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:35.745322 1357 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a86338554ab426ba9a4c519939aa92b" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34889 } }
I20260806 00:57:35.745594 3466 external_mini_cluster.cc:1428] Setting key 6c4210e71a048de423bf012a51c59960
I20260806 00:57:35.745750 1358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a86338554ab426ba9a4c519939aa92b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a86338554ab426ba9a4c519939aa92b" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34889 } } }
I20260806 00:57:35.745851 1358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:35.745764 1359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a86338554ab426ba9a4c519939aa92b. Latest consensus state: current_term: 1 leader_uuid: "6a86338554ab426ba9a4c519939aa92b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a86338554ab426ba9a4c519939aa92b" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 34889 } } }
I20260806 00:57:35.746021 1359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:35.746421 1365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:35.747233 1365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:35.748987 1365 catalog_manager.cc:1347] Generated new cluster ID: 1c6081ab158f4cab84bcd63d1a01c743
I20260806 00:57:35.749107 1365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 00:57:35 dist-test-slave-44d2 krb5kdc[1236](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:35.757694 1371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:35.746332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60707 (local address 127.3.98.190:34889)
0806 00:57:35.746519 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:35.746528 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:35.746561 (+ 33us) server_negotiation.cc:407] Connection header received
0806 00:57:35.746681 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:35.746688 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:35.746776 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:35.746972 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:35.747818 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:35.748992 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:35.750047 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:35.750663 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:35.750776 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:35.753768 (+ 2992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:35.753772 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:35.753772 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:35.753785 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:35.755842 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:35.756270 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:35.756273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:35.756274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:35.756394 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:35.756648 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:35.756649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:35.756649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:35.756943 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:35.757106 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:35.757227 (+ 121us) server_negotiation.cc:299] Negotiation successful
0806 00:57:35.757361 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":107,"threads_started":1}
I20260806 00:57:35.759428 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:35.759991 1365 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:35.760452 1365 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:35.764292 1365 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a86338554ab426ba9a4c519939aa92b: Generated new TSK 0
I20260806 00:57:35.764469 1365 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:35.768175 1371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:35.760999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38621 (local address 127.3.98.190:34889)
0806 00:57:35.761044 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:35.761046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:35.761205 (+ 159us) server_negotiation.cc:407] Connection header received
0806 00:57:35.761252 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:35.761252 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:35.761263 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:35.761315 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:35.761937 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:35.762689 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:35.763901 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:35.764192 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:35.764252 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:35.765688 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:35.765689 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:35.765690 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:35.765695 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:35.767119 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:35.767496 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:35.767496 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:35.767497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:35.767545 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:35.767742 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:35.767743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:35.767743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:35.767833 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:35.767914 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:35.768046 (+ 132us) server_negotiation.cc:299] Negotiation successful
0806 00:57:35.768120 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 00:57:35.770100 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 1251
2026-08-06T00:57:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1602 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:35 dist-test-slave-44d2 krb5kdc[1397](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:35 dist-test-slave-44d2 krb5kdc[1397](info): set up 2 sockets
Aug 06 00:57:35 dist-test-slave-44d2 krb5kdc[1397](info): commencing operation
krb5kdc: starting...
W20260806 00:57:36.994014 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:37 dist-test-slave-44d2 krb5kdc[1397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:57:37.127540 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44297
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:46167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:44297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:37.212779 1413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:37.213023 1413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:37.213063 1413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:37.214200 1413 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:37.214269 1413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:37.214295 1413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:37.214326 1413 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:37.214349 1413 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:37.215785 1413 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:46167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:44297
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:44297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:37.216059 1413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:37.216300 1413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:37.221230 1421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:37.221304 1422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:37.221242 1425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:37.221400 1413 server_base.cc:1034] running on GCE node
I20260806 00:57:37.221750 1413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:37.222083 1413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:37.223260 1413 hybrid_clock.cc:648] HybridClock initialized: now 1785977857223243 us; error 28 us; skew 500 ppm
Aug 06 00:57:37 dist-test-slave-44d2 krb5kdc[1397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977857, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:37.226029 1413 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:57:37.226513 1413 webserver.cc:460] Webserver started at http://127.3.98.190:40027/ using document root <none> and password file <none>
I20260806 00:57:37.226750 1413 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:37.226821 1413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:37.226979 1413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:37.228052 1413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "b2038a7e8aff40b489dbab27301b5ce2"
format_stamp: "Formatted at 2026-08-06 00:57:37 on dist-test-slave-44d2"
server_key: "9a505407607d9f8d38ee0d8c3dae627b"
server_key_iv: "ebbad4f8050a81952c8c8bdd7c80ec3f"
server_key_version: "encryptionkey@0"
I20260806 00:57:37.228423 1413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "b2038a7e8aff40b489dbab27301b5ce2"
format_stamp: "Formatted at 2026-08-06 00:57:37 on dist-test-slave-44d2"
server_key: "9a505407607d9f8d38ee0d8c3dae627b"
server_key_iv: "ebbad4f8050a81952c8c8bdd7c80ec3f"
server_key_version: "encryptionkey@0"
I20260806 00:57:37.229830 1413 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:37.230566 1435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:37.230723 1413 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:37.230827 1413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "b2038a7e8aff40b489dbab27301b5ce2"
format_stamp: "Formatted at 2026-08-06 00:57:37 on dist-test-slave-44d2"
server_key: "9a505407607d9f8d38ee0d8c3dae627b"
server_key_iv: "ebbad4f8050a81952c8c8bdd7c80ec3f"
server_key_version: "encryptionkey@0"
I20260806 00:57:37.230901 1413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:37.261915 1413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:37.264581 1413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:37.264761 1413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:37.269191 1413 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:44297
I20260806 00:57:37.269271 1506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:44297 every 8 connection(s)
I20260806 00:57:37.269649 1413 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:37.270648 1507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:37.273232 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 1413
I20260806 00:57:37.273339 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:37.273456 1507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2: Bootstrap starting.
I20260806 00:57:37.273604 3466 external_mini_cluster.cc:1428] Setting key b07a7e2d4a57b5a712c427a617844851
I20260806 00:57:37.274400 1507 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:37.274804 1507 log.cc:824] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:37.275661 1507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2: No bootstrap required, opened a new log
I20260806 00:57:37.278501 1507 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2038a7e8aff40b489dbab27301b5ce2" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44297 } }
I20260806 00:57:37.278694 1507 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:37.278740 1507 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2038a7e8aff40b489dbab27301b5ce2, State: Initialized, Role: FOLLOWER
I20260806 00:57:37.278894 1507 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2038a7e8aff40b489dbab27301b5ce2" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44297 } }
I20260806 00:57:37.279004 1507 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:37.279116 1507 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:37.279192 1507 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:37.280009 1507 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2038a7e8aff40b489dbab27301b5ce2" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44297 } }
I20260806 00:57:37.280146 1507 leader_election.cc:302] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2038a7e8aff40b489dbab27301b5ce2; no voters:
I20260806 00:57:37.280349 1507 leader_election.cc:288] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:37.280563 1514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:37.280587 1510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:37.274236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33583 (local address 127.3.98.190:44297)
0806 00:57:37.274467 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:37.274478 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:37.274520 (+ 42us) server_negotiation.cc:407] Connection header received
0806 00:57:37.275262 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:37.275274 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:37.275346 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:37.275515 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:37.275737 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:37.277320 (+ 1583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:37.278151 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:37.278863 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:37.278994 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:37.279734 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:37.279739 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:37.279740 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:37.279998 (+ 258us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:37.280047 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:37.280064 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:37.280163 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:37.280241 (+ 78us) server_negotiation.cc:299] Negotiation successful
0806 00:57:37.280319 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":90,"threads_started":1}
I20260806 00:57:37.280648 1507 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:37.280788 1514 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [term 1 LEADER]: Becoming Leader. State: Replica: b2038a7e8aff40b489dbab27301b5ce2, State: Running, Role: LEADER
I20260806 00:57:37.280877 1514 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2038a7e8aff40b489dbab27301b5ce2" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44297 } }
I20260806 00:57:37.281349 1515 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2038a7e8aff40b489dbab27301b5ce2. Latest consensus state: current_term: 1 leader_uuid: "b2038a7e8aff40b489dbab27301b5ce2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2038a7e8aff40b489dbab27301b5ce2" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44297 } } }
I20260806 00:57:37.281515 1515 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:37.281665 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:37.282047 1527 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:37.282281 1512 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2038a7e8aff40b489dbab27301b5ce2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2038a7e8aff40b489dbab27301b5ce2" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 44297 } } }
I20260806 00:57:37.282356 1512 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:37.282629 1527 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:37.284629 1527 catalog_manager.cc:1347] Generated new cluster ID: dd1c0b4903974e2594c8f84ca77d2790
I20260806 00:57:37.284698 1527 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:37.286644 1510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:37.283435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48303 (local address 127.3.98.190:44297)
0806 00:57:37.283473 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:37.283475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:37.283729 (+ 254us) server_negotiation.cc:407] Connection header received
0806 00:57:37.283801 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:37.283802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:37.283812 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:37.283869 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:37.284072 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:37.284706 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:37.285427 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:37.285644 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:37.285723 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:37.286400 (+ 677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:37.286401 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:37.286401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:37.286406 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:37.286421 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:37.286425 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:37.286479 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:37.286546 (+ 67us) server_negotiation.cc:299] Negotiation successful
0806 00:57:37.286568 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 00:57:37.293588 1527 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:37.294374 1527 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:37.303751 1527 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2038a7e8aff40b489dbab27301b5ce2: Generated new TSK 0
I20260806 00:57:37.303975 1527 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:37.306478 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 1413
2026-08-06T00:57:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1538 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:37 dist-test-slave-44d2 krb5kdc[1552](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:37 dist-test-slave-44d2 krb5kdc[1552](info): set up 2 sockets
Aug 06 00:57:37 dist-test-slave-44d2 krb5kdc[1552](info): commencing operation
krb5kdc: starting...
W20260806 00:57:38.543205 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.209s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:38 dist-test-slave-44d2 krb5kdc[1552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:57:38.670794 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:40575
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:39503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:40575
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:38.753494 1569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:38.753705 1569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:38.753728 1569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:38.754801 1569 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:38.754838 1569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:38.754853 1569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:38.754865 1569 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:38.754877 1569 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:38.756275 1569 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:39503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:40575
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:40575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:38.756470 1569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:38.756734 1569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 00:57:38.761782 1569 server_base.cc:1034] running on GCE node
W20260806 00:57:38.761721 1577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:38.761718 1578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:38.761724 1580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:38.762171 1569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:38.762423 1569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:38.763572 1569 hybrid_clock.cc:648] HybridClock initialized: now 1785977858763547 us; error 46 us; skew 500 ppm
Aug 06 00:57:38 dist-test-slave-44d2 krb5kdc[1552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977858, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:38.766124 1569 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:57:38.766498 1569 webserver.cc:460] Webserver started at http://127.3.98.190:42191/ using document root <none> and password file <none>
I20260806 00:57:38.766700 1569 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:38.766742 1569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:38.766834 1569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:38.767841 1569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "46560707baad49a5aae2bec1899a7a66"
format_stamp: "Formatted at 2026-08-06 00:57:38 on dist-test-slave-44d2"
server_key: "aba4e4576126f469a6b62d875134740d"
server_key_iv: "190cee6177d942f2edb3c31bc23b1210"
server_key_version: "encryptionkey@0"
I20260806 00:57:38.768151 1569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "46560707baad49a5aae2bec1899a7a66"
format_stamp: "Formatted at 2026-08-06 00:57:38 on dist-test-slave-44d2"
server_key: "aba4e4576126f469a6b62d875134740d"
server_key_iv: "190cee6177d942f2edb3c31bc23b1210"
server_key_version: "encryptionkey@0"
I20260806 00:57:38.769805 1569 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 00:57:38.770548 1587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:38.770746 1569 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:38.770838 1569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "46560707baad49a5aae2bec1899a7a66"
format_stamp: "Formatted at 2026-08-06 00:57:38 on dist-test-slave-44d2"
server_key: "aba4e4576126f469a6b62d875134740d"
server_key_iv: "190cee6177d942f2edb3c31bc23b1210"
server_key_version: "encryptionkey@0"
I20260806 00:57:38.770895 1569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:38.774155 1569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:38.776188 1569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:38.776300 1569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:38.780227 1569 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:40575
I20260806 00:57:38.780300 1651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:40575 every 8 connection(s)
I20260806 00:57:38.780699 1569 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:38.781759 1652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:38.784106 1652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66: Bootstrap starting.
I20260806 00:57:38.784795 1652 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:38.785116 1652 log.cc:824] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:38.785873 1652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66: No bootstrap required, opened a new log
I20260806 00:57:38.786118 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 1569
I20260806 00:57:38.786237 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:38.786433 3466 external_mini_cluster.cc:1428] Setting key 818ece7d4b0cde438c9c07ad7b1e5e27
I20260806 00:57:38.788337 1652 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46560707baad49a5aae2bec1899a7a66" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40575 } }
I20260806 00:57:38.788591 1652 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 00:57:38.788655 1652 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46560707baad49a5aae2bec1899a7a66, State: Initialized, Role: FOLLOWER
I20260806 00:57:38.788843 1652 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46560707baad49a5aae2bec1899a7a66" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40575 } }
I20260806 00:57:38.788954 1652 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 00:57:38.788987 1652 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 00:57:38.789037 1652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:38.789850 1659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:38.787014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55903 (local address 127.3.98.190:40575)
0806 00:57:38.787223 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:38.787232 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:38.787274 (+ 42us) server_negotiation.cc:407] Connection header received
0806 00:57:38.788298 (+ 1024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:38.788308 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:38.788347 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:38.788530 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:38.789315 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:38.789320 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:38.789320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:38.789325 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:38.789382 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:38.789400 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:38.789484 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:38.789560 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 00:57:38.789608 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":90,"threads_started":1}
I20260806 00:57:38.790233 1652 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46560707baad49a5aae2bec1899a7a66" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40575 } }
I20260806 00:57:38.790340 1652 leader_election.cc:302] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46560707baad49a5aae2bec1899a7a66; no voters:
I20260806 00:57:38.790511 1652 leader_election.cc:288] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 00:57:38.790572 1660 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:38.790716 1660 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [term 1 LEADER]: Becoming Leader. State: Replica: 46560707baad49a5aae2bec1899a7a66, State: Running, Role: LEADER
I20260806 00:57:38.790793 1652 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:38.790855 1660 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46560707baad49a5aae2bec1899a7a66" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40575 } }
I20260806 00:57:38.790934 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:38.791291 1660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46560707baad49a5aae2bec1899a7a66. Latest consensus state: current_term: 1 leader_uuid: "46560707baad49a5aae2bec1899a7a66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46560707baad49a5aae2bec1899a7a66" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40575 } } }
I20260806 00:57:38.791528 1660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:38.791453 1662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46560707baad49a5aae2bec1899a7a66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46560707baad49a5aae2bec1899a7a66" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 40575 } } }
I20260806 00:57:38.791787 1662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66 [sys.catalog]: This master's current role is: LEADER
W20260806 00:57:38.792840 1683 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 00:57:38.792888 1683 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:57:38.792966 1670 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:38.793165 1670 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:38.794173 1659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:38.792620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56073 (local address 127.3.98.190:40575)
0806 00:57:38.792656 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:38.792659 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:38.793068 (+ 409us) server_negotiation.cc:407] Connection header received
0806 00:57:38.793158 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:38.793159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:38.793177 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:38.793240 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:38.793931 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:38.793932 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:38.793933 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 00:57:38.793937 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:38.793961 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 00:57:38.793966 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:38.794028 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:38.794094 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 00:57:38.794108 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:57:38.794772 1670 catalog_manager.cc:1347] Generated new cluster ID: 564de24e175a423a90c97bfdc742aa2c
I20260806 00:57:38.794823 1670 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:38.814090 1670 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:38.814327 1670 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:38.817397 1670 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46560707baad49a5aae2bec1899a7a66: Generated new TSK 0
I20260806 00:57:38.817613 1670 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 00:57:38.819989 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 1569
2026-08-06T00:57:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1515 ms)
[----------] 18 tests from AuthTokenIssuingTest (27948 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:38 dist-test-slave-44d2 krb5kdc[1693](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:38 dist-test-slave-44d2 krb5kdc[1693](info): set up 2 sockets
Aug 06 00:57:38 dist-test-slave-44d2 krb5kdc[1693](info): commencing operation
krb5kdc: starting...
W20260806 00:57:40.121165 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.272s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:57:40.246593 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:39917
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:39917,127.3.98.189:41689,127.3.98.188:39313
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:40.333775 1715 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 00:57:40.334056 1715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:40.334090 1715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:40.334132 1715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:40.335254 1715 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:40.335326 1715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:40.335350 1715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:40.335371 1715 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:40.335397 1715 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:40.336891 1715 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:39917,127.3.98.189:41689,127.3.98.188:39313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:39917
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:40.337167 1715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:40.337404 1715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:40.342311 1723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:40.342344 1726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:40.342311 1722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:40.342577 1715 server_base.cc:1034] running on GCE node
I20260806 00:57:40.342818 1715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:40.343111 1715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:40.344280 1715 hybrid_clock.cc:648] HybridClock initialized: now 1785977860344267 us; error 47 us; skew 500 ppm
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:40.351686 1715 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:57:40.352146 1715 webserver.cc:460] Webserver started at http://127.3.98.190:46459/ using document root <none> and password file <none>
I20260806 00:57:40.352380 1715 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:40.352450 1715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:40.352629 1715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:40.353708 1715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "9fca3e927de34443a51584cf87250f52"
format_stamp: "Formatted at 2026-08-06 00:57:40 on dist-test-slave-44d2"
server_key: "2fbfb4a3ba5881c6c89f403bacae54ff"
server_key_iv: "98e5c9f0f74de310e7237ef15b566bba"
server_key_version: "encryptionkey@0"
I20260806 00:57:40.354090 1715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "9fca3e927de34443a51584cf87250f52"
format_stamp: "Formatted at 2026-08-06 00:57:40 on dist-test-slave-44d2"
server_key: "2fbfb4a3ba5881c6c89f403bacae54ff"
server_key_iv: "98e5c9f0f74de310e7237ef15b566bba"
server_key_version: "encryptionkey@0"
I20260806 00:57:40.355481 1715 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 00:57:40.356299 1736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:40.356527 1715 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:57:40.356626 1715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "9fca3e927de34443a51584cf87250f52"
format_stamp: "Formatted at 2026-08-06 00:57:40 on dist-test-slave-44d2"
server_key: "2fbfb4a3ba5881c6c89f403bacae54ff"
server_key_iv: "98e5c9f0f74de310e7237ef15b566bba"
server_key_version: "encryptionkey@0"
I20260806 00:57:40.356714 1715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:40.376611 1715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:40.378609 1715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:40.378791 1715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:40.383170 1715 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:39917
I20260806 00:57:40.383226 1802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:39917 every 8 connection(s)
I20260806 00:57:40.383626 1715 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:40.384775 1803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:40.386449 1803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:57:40.392217 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 1715
I20260806 00:57:40.392319 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:40.392541 3466 external_mini_cluster.cc:1428] Setting key 05959e899072abece2b56a1186847ed5
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:40.397074 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.387211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39917 (local address 127.0.0.1:40070)
0806 00:57:40.387391 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.387430 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:40.387895 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:40.388158 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:40.388161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:40.388412 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:40.388611 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.388616 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.389786 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.389787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.390465 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.390467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.390993 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.390994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.391050 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.391542 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:40.391550 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:40.393235 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:40.395312 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.395320 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.395331 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.395631 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.395884 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.395885 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.395886 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.395994 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.396532 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:40.396541 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:40.396614 (+ 73us) client_negotiation.cc:769] Sending connection context
0806 00:57:40.396702 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 00:57:40.396840 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":89,"threads_started":1}
I20260806 00:57:40.397099 1808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.387237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40070 (local address 127.3.98.190:39917)
0806 00:57:40.387407 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.387417 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.387549 (+ 132us) server_negotiation.cc:407] Connection header received
0806 00:57:40.388023 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.388024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.388043 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.388128 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.388719 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.389691 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.390560 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.390888 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.390983 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.393325 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.393335 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.393335 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.393343 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.395218 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.395727 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.395730 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.395730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.395810 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.396098 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.396100 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.396100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.396398 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.396507 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.396766 (+ 259us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.396930 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":131,"thread_start_us":104,"threads_started":1}
I20260806 00:57:40.397954 1803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:57:40.398325 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.398212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:41689 (local address 127.0.0.1:44542)
0806 00:57:40.398259 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.398304 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 00:57:40.398509 1741 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.98.189:41689: connect: Connection refused (error 111)
I20260806 00:57:40.398954 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.398869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:41689 (local address 127.0.0.1:44550)
0806 00:57:40.398913 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.398938 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 00:57:40.399096 1803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.189:41689: Network error: Client connection negotiation failed: client connection to 127.3.98.189:41689: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.3.98.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.189.keytab.
Entry for principal kudu/127.3.98.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.189.keytab.
I20260806 00:57:40.421084 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.189:41689
--webserver_interface=127.3.98.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.189.keytab
--principal=kudu/127.3.98.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:39917,127.3.98.189:41689,127.3.98.188:39313
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:57:40.448376 1803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } attempt: 1
I20260806 00:57:40.448958 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.448815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:41689 (local address 127.0.0.1:44560)
0806 00:57:40.448884 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.448925 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 00:57:40.449456 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.449366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:41689 (local address 127.0.0.1:44572)
0806 00:57:40.449408 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.449436 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 00:57:40.449612 1803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.189:41689: Network error: Client connection negotiation failed: client connection to 127.3.98.189:41689: connect: Connection refused (error 111)
W20260806 00:57:40.504724 1813 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 00:57:40.504999 1813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:40.505033 1813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:40.505088 1813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:40.506220 1813 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:40.506296 1813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:40.506319 1813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:40.506340 1813 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:40.506372 1813 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:40.507853 1813 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:39917,127.3.98.189:41689,127.3.98.188:39313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.189.keytab
--principal=kudu/127.3.98.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.189:41689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.3.98.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:40.508162 1813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:40.508395 1813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:40.513572 1822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:40.513576 1819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:40.513669 1820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:40.514341 1813 server_base.cc:1034] running on GCE node
I20260806 00:57:40.514628 1813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:40.514966 1813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:40.516144 1813 hybrid_clock.cc:648] HybridClock initialized: now 1785977860516137 us; error 33 us; skew 500 ppm
I20260806 00:57:40.517761 1803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } attempt: 2
I20260806 00:57:40.518173 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.518019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:41689 (local address 127.0.0.1:44584)
0806 00:57:40.518090 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.518131 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260806 00:57:40.518561 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.518463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:41689 (local address 127.0.0.1:44594)
0806 00:57:40.518512 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.518539 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:41689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 00:57:40.518719 1803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.189:41689: Network error: Client connection negotiation failed: client connection to 127.3.98.189:41689: connect: Connection refused (error 111)
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:40.519367 1813 init.cc:377] Logged in from keytab as kudu/127.3.98.189@KRBTEST.COM (short username kudu)
I20260806 00:57:40.519801 1813 webserver.cc:460] Webserver started at http://127.3.98.189:32877/ using document root <none> and password file <none>
I20260806 00:57:40.520069 1813 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:40.520124 1813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:40.520239 1813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:40.521443 1813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/data/instance:
uuid: "5f45ac704383432881193433b560a450"
format_stamp: "Formatted at 2026-08-06 00:57:40 on dist-test-slave-44d2"
server_key: "f286cd71a2c11128b72e47d05a437ae3"
server_key_iv: "d55649dcf22e7f5eab6089a95a9c8d11"
server_key_version: "encryptionkey@0"
I20260806 00:57:40.521781 1813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/wal/instance:
uuid: "5f45ac704383432881193433b560a450"
format_stamp: "Formatted at 2026-08-06 00:57:40 on dist-test-slave-44d2"
server_key: "f286cd71a2c11128b72e47d05a437ae3"
server_key_iv: "d55649dcf22e7f5eab6089a95a9c8d11"
server_key_version: "encryptionkey@0"
I20260806 00:57:40.523182 1813 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 00:57:40.524092 1831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:40.524291 1813 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 00:57:40.524408 1813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/wal
uuid: "5f45ac704383432881193433b560a450"
format_stamp: "Formatted at 2026-08-06 00:57:40 on dist-test-slave-44d2"
server_key: "f286cd71a2c11128b72e47d05a437ae3"
server_key_iv: "d55649dcf22e7f5eab6089a95a9c8d11"
server_key_version: "encryptionkey@0"
I20260806 00:57:40.524528 1813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:40.540047 1813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:40.542150 1813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:40.542330 1813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:40.546903 1813 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.189:41689
I20260806 00:57:40.546936 1904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.189:41689 every 8 connection(s)
I20260806 00:57:40.547338 1813 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/data/info.pb
I20260806 00:57:40.548360 1905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:40.549965 1905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.189@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:40.556777 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 1813
I20260806 00:57:40.556941 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-1/wal/instance
I20260806 00:57:40.557188 3466 external_mini_cluster.cc:1428] Setting key d8ace75b88eb3b029d046dfa706950c9
I20260806 00:57:40.560042 1808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.550710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40082 (local address 127.3.98.190:39917)
0806 00:57:40.550799 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.550801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.550965 (+ 164us) server_negotiation.cc:407] Connection header received
0806 00:57:40.551489 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.551490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.551508 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.551596 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.552253 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.552864 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.553888 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.554114 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.554194 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.556466 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.556468 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.556468 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.556501 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.558401 (+ 1900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.558902 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.558903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.558904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.558978 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.559308 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.559309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.559310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.559444 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.559529 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.559820 (+ 291us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.559949 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 00:57:40.560266 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.550612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39917 (local address 127.0.0.1:40082)
0806 00:57:40.550834 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.550884 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:40.551376 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:40.551670 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:40.551674 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:40.551948 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:40.552149 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.552154 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.552964 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.552965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.553792 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.553795 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.554215 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.554217 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.554360 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.554922 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:40.554931 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:40.556357 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:40.558501 (+ 2144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.558509 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.558512 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.558812 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.559064 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.559065 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.559065 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.559249 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.559525 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:40.559534 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:40.559682 (+ 148us) client_negotiation.cc:769] Sending connection context
0806 00:57:40.559796 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 00:57:40.559971 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":95,"threads_started":1}
I20260806 00:57:40.560849 1905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.189@KRBTEST.COM for kudu/127.3.98.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.98.188@KRBTEST.COM; defaulting to no policy
I20260806 00:57:40.568035 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.561135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:41689 (local address 127.0.0.1:44608)
0806 00:57:40.561352 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.561363 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:40.561415 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:40.561573 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:40.561575 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:40.561723 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:40.561768 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.561770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.562630 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.562631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.563132 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.563133 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.563625 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.563626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.563695 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.564134 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:40.564139 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:40.565358 (+ 1219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:40.567108 (+ 1750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.567109 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.567109 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.567275 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.567465 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.567466 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.567466 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.567521 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.567779 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:40.567780 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:40.567817 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 00:57:40.567869 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 00:57:40.567952 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204}
I20260806 00:57:40.568146 1913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.561201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44608 (local address 127.3.98.189:41689)
0806 00:57:40.561365 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.561370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.561413 (+ 43us) server_negotiation.cc:407] Connection header received
0806 00:57:40.561472 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.561475 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.561487 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.561567 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.561845 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.562532 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.563213 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.563539 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.563617 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.565449 (+ 1832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.565459 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.565460 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.565468 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.567028 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.567345 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.567348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.567349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.567405 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.567581 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.567582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.567582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.567723 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.567786 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.567901 (+ 115us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.568011 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":131,"thread_start_us":102,"threads_started":1}
I20260806 00:57:40.568934 1905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.188@KRBTEST.COM" created.
I20260806 00:57:40.569341 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.569214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:39313 (local address 127.0.0.1:58678)
0806 00:57:40.569264 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.569311 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 00:57:40.569507 1835 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
I20260806 00:57:40.569931 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.569843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:39313 (local address 127.0.0.1:58686)
0806 00:57:40.569890 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.569915 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260806 00:57:40.571038 1905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:39313: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.188.keytab.
Entry for principal kudu/127.3.98.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.188.keytab.
I20260806 00:57:40.588116 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.188:39313
--webserver_interface=127.3.98.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.188.keytab
--principal=kudu/127.3.98.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:41913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:39917,127.3.98.189:41689,127.3.98.188:39313
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:57:40.609866 1803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } attempt: 3
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for kudu/127.3.98.189@KRBTEST.COM
I20260806 00:57:40.617496 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.610236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:41689 (local address 127.0.0.1:44610)
0806 00:57:40.610306 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.610323 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:40.610394 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:40.610553 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:40.610554 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:40.610732 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:40.610802 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.610804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.611490 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.611491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.612033 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.612035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.612550 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.612551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.612660 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.613154 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:40.613160 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:40.614525 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:40.616319 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.616320 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.616321 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.616557 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.616789 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.616790 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.616791 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.616859 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.617133 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:40.617134 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:40.617185 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 00:57:40.617281 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 00:57:40.617391 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 00:57:40.617496 1913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.610319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44610 (local address 127.3.98.189:41689)
0806 00:57:40.610390 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.610392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.610405 (+ 13us) server_negotiation.cc:407] Connection header received
0806 00:57:40.610460 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.610461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.610476 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.610544 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.610889 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.611402 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.612140 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.612410 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.612528 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.614650 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.614651 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.614652 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.614664 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.616210 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.616654 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.616656 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.616657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.616720 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.616938 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.616938 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.616939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.617057 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.617128 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.617308 (+ 180us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.617393 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 00:57:40.617861 1803 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:57:40.618229 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.618125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:39313 (local address 127.0.0.1:58688)
0806 00:57:40.618175 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.618202 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 00:57:40.618611 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.618525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:39313 (local address 127.0.0.1:58690)
0806 00:57:40.618572 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.618596 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260806 00:57:40.618719 1803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:39313: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
I20260806 00:57:40.620249 1905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } attempt: 1
I20260806 00:57:40.620633 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.620530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:39313 (local address 127.0.0.1:58696)
0806 00:57:40.620578 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.620611 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260806 00:57:40.620947 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.620886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:39313 (local address 127.0.0.1:58704)
0806 00:57:40.620914 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.620934 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260806 00:57:40.621050 1905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:39313: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
I20260806 00:57:40.649817 1803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } attempt: 1
I20260806 00:57:40.650332 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.650166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:39313 (local address 127.0.0.1:58712)
0806 00:57:40.650224 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.650290 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260806 00:57:40.650847 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.650605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:39313 (local address 127.0.0.1:58720)
0806 00:57:40.650776 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.650808 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":120,"threads_started":1}
W20260806 00:57:40.650939 1803 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:39313: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
W20260806 00:57:40.679418 1916 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 00:57:40.679638 1916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:40.679656 1916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:40.679675 1916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:40.680814 1916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:40.680857 1916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:40.680872 1916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:40.680884 1916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:40.680897 1916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:40.682390 1916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:41913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:39917,127.3.98.189:41689,127.3.98.188:39313
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.188.keytab
--principal=kudu/127.3.98.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.188:39313
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.3.98.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1916
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:40.682601 1916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:40.682786 1916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:40.687752 1925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:40.687897 1916 server_base.cc:1034] running on GCE node
W20260806 00:57:40.687790 1924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:40.687752 1927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:40.688295 1916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:40.688691 1916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:40.689183 1905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } attempt: 2
I20260806 00:57:40.689646 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.689516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:39313 (local address 127.0.0.1:58724)
0806 00:57:40.689586 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.689619 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260806 00:57:40.689843 1916 hybrid_clock.cc:648] HybridClock initialized: now 1785977860689826 us; error 31 us; skew 500 ppm
I20260806 00:57:40.690026 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.689928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:39313 (local address 127.0.0.1:58732)
0806 00:57:40.689976 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.690007 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 00:57:40.690128 1905 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:39313: Network error: Client connection negotiation failed: client connection to 127.3.98.188:39313: connect: Connection refused (error 111)
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:40.692745 1916 init.cc:377] Logged in from keytab as kudu/127.3.98.188@KRBTEST.COM (short username kudu)
I20260806 00:57:40.693269 1916 webserver.cc:460] Webserver started at http://127.3.98.188:42457/ using document root <none> and password file <none>
I20260806 00:57:40.693524 1916 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:40.693572 1916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:40.693713 1916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:40.694792 1916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/data/instance:
uuid: "f4c4aadca566442a88a18753c1bccdeb"
format_stamp: "Formatted at 2026-08-06 00:57:40 on dist-test-slave-44d2"
server_key: "1258698a83e974822d241dc0e27433bb"
server_key_iv: "3e15502f068287a67855fcd4b67a35ba"
server_key_version: "encryptionkey@0"
I20260806 00:57:40.695170 1916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/wal/instance:
uuid: "f4c4aadca566442a88a18753c1bccdeb"
format_stamp: "Formatted at 2026-08-06 00:57:40 on dist-test-slave-44d2"
server_key: "1258698a83e974822d241dc0e27433bb"
server_key_iv: "3e15502f068287a67855fcd4b67a35ba"
server_key_version: "encryptionkey@0"
I20260806 00:57:40.696622 1916 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 00:57:40.697373 1934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:40.697561 1916 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:40.697666 1916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/wal
uuid: "f4c4aadca566442a88a18753c1bccdeb"
format_stamp: "Formatted at 2026-08-06 00:57:40 on dist-test-slave-44d2"
server_key: "1258698a83e974822d241dc0e27433bb"
server_key_iv: "3e15502f068287a67855fcd4b67a35ba"
server_key_version: "encryptionkey@0"
I20260806 00:57:40.697749 1916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:40.706147 1916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:40.707967 1916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:40.708142 1916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:40.712699 1916 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.188:39313
I20260806 00:57:40.712736 1996 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.188:39313 every 8 connection(s)
I20260806 00:57:40.713091 1916 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/data/info.pb
I20260806 00:57:40.713876 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 1916
I20260806 00:57:40.714075 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785977579314977-3466-0/minicluster-data/master-2/wal/instance
I20260806 00:57:40.714275 3466 external_mini_cluster.cc:1428] Setting key 387243a0a9c35ea8070e37eac85e1991
I20260806 00:57:40.714306 1997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:40.716858 1997 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.188@KRBTEST.COM
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.188@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:40.726059 1803 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } attempt: 2
I20260806 00:57:40.726481 1808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.717572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40088 (local address 127.3.98.190:39917)
0806 00:57:40.717634 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.717636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.717788 (+ 152us) server_negotiation.cc:407] Connection header received
0806 00:57:40.717865 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.717866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.717877 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.717920 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.718493 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.719147 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.720588 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.720771 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.720835 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.723237 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.723239 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.723240 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.723250 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.724937 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.725401 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.725402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.725402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.725484 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.725712 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.725713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.725714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.725860 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.725947 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.726262 (+ 315us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.726348 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 00:57:40.726753 2000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.714855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58744 (local address 127.3.98.188:39313)
0806 00:57:40.715034 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.715050 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.715076 (+ 26us) server_negotiation.cc:407] Connection header received
0806 00:57:40.715458 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.715463 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.715508 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.715627 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.716553 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.717625 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.718712 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.719336 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.719416 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.722369 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.722381 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.722381 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.722388 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.724562 (+ 2174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.725091 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.725095 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.725095 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.725233 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.725466 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.725467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.725467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.725858 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.726029 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.726241 (+ 212us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.726403 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":98,"threads_started":1}
I20260806 00:57:40.726863 2004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.717501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:39917 (local address 127.0.0.1:40088)
0806 00:57:40.717680 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.717726 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:40.717803 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:40.717989 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:40.717993 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:40.718325 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:40.718416 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.718418 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.719300 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.719301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.720387 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.720390 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.720967 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.720969 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.721065 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.721616 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:40.721634 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:40.723140 (+ 1506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:40.725016 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.725023 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.725026 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.725323 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.725570 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.725571 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.725571 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.725639 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.725955 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:40.725964 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:40.726043 (+ 79us) client_negotiation.cc:769] Sending connection context
0806 00:57:40.726583 (+ 540us) client_negotiation.cc:240] Negotiation successful
0806 00:57:40.726711 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":98,"threads_started":1}
I20260806 00:57:40.727411 1997 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for kudu/127.3.98.188@KRBTEST.COM
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.188@KRBTEST.COM for kudu/127.3.98.189@KRBTEST.COM
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:40.735814 2004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.727659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:41689 (local address 127.0.0.1:44620)
0806 00:57:40.727733 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.727742 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:40.727778 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:40.727963 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:40.727964 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:40.728115 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:40.728178 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.728180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.729176 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.729177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.729960 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.729962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.730364 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.730365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.730433 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.730999 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:40.731004 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:40.732476 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:40.734573 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.734574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.734575 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.734803 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.735049 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.735050 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.735050 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.735106 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.735429 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:40.735430 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:40.735475 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 00:57:40.735622 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 00:57:40.735721 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260806 00:57:40.735826 1913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.727761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44620 (local address 127.3.98.189:41689)
0806 00:57:40.727805 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.727807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.727817 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:57:40.727859 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.727859 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.727869 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.727934 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.728297 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.729109 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.730030 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.730286 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.730354 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.732606 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.732607 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.732608 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.732616 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.734474 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.734880 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.734882 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.734882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.734964 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.735191 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.735193 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.735193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.735314 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.735398 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.735657 (+ 259us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.735738 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 00:57:40.736194 1997 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:57:40.736826 1807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.726346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:39313 (local address 127.0.0.1:58752)
0806 00:57:40.726454 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.726465 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:40.726507 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:40.726889 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:40.726890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:40.727064 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:40.727111 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.727113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.728115 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.728116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.729042 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.729045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.729533 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.729534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.729598 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.730420 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:40.730425 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:40.732792 (+ 2367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:40.735617 (+ 2825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.735618 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.735619 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.735868 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.736091 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.736092 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.736092 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.736152 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.736409 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:40.736410 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:40.736462 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 00:57:40.736587 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 00:57:40.736713 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260806 00:57:40.737439 2005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.726586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58752 (local address 127.3.98.188:39313)
0806 00:57:40.726725 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.726727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.726735 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:57:40.726756 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.726758 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.726769 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.727238 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.727286 (+ 48us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.728025 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.729207 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.729446 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.729534 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.732893 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.732894 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.732894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.732901 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.735538 (+ 2637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.735960 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.735960 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.735961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.736018 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.736219 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.736220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.736220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.736345 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.736417 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.737232 (+ 815us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.737308 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
I20260806 00:57:40.737813 1808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.727666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40104 (local address 127.3.98.190:39917)
0806 00:57:40.727700 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.727702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.727758 (+ 56us) server_negotiation.cc:407] Connection header received
0806 00:57:40.727856 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.727857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.727866 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.727920 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.728567 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.729007 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.729995 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.730211 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.730241 (+ 30us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.734562 (+ 4321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.734563 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.734564 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.734569 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.736602 (+ 2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.737028 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.737029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.737029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.737091 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.737300 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.737301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.737301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.737412 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.737607 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.737644 (+ 37us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.737712 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260806 00:57:40.739792 1803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52: Bootstrap starting.
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.188@KRBTEST.COM for kudu/127.3.98.188@KRBTEST.COM
I20260806 00:57:40.740566 1803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:40.740916 1803 log.cc:824] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:40.742158 1803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52: No bootstrap required, opened a new log
I20260806 00:57:40.743918 2004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.736438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:39313 (local address 127.0.0.1:58764)
0806 00:57:40.736663 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.736674 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:40.736714 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:40.736853 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:40.736854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:40.737016 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:40.737046 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.737048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.737967 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.737968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.738707 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.738710 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.739165 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.739166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.739228 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.739563 (+ 335us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:40.739569 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:40.740841 (+ 1272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:40.742839 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.742839 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.742839 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.743027 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.743250 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.743251 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.743252 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.743318 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.743623 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:40.743624 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:40.743666 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 00:57:40.743739 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 00:57:40.743827 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":107,"threads_started":1}
I20260806 00:57:40.744182 2000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.736604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58764 (local address 127.3.98.188:39313)
0806 00:57:40.736640 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.736641 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.736758 (+ 117us) server_negotiation.cc:407] Connection header received
0806 00:57:40.736772 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.736773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.736781 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.736849 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.737136 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.737876 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.738800 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.739076 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.739129 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.740933 (+ 1804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.740934 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.740935 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.740941 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.742751 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.743105 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.743106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.743107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.743166 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.743389 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.743390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.743390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.743543 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.743615 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.744028 (+ 413us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.744099 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 00:57:40.744419 1803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } }
I20260806 00:57:40.744601 1803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fca3e927de34443a51584cf87250f52, State: Initialized, Role: FOLLOWER
I20260806 00:57:40.744699 1803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } }
I20260806 00:57:40.744985 2008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } } }
I20260806 00:57:40.745048 1803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:40.745060 2008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:57:40.745779 1997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb: Bootstrap starting.
I20260806 00:57:40.746479 1997 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb: Neither blocks nor log segments found. Creating new log.
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.189@KRBTEST.COM
I20260806 00:57:40.746793 1997 log.cc:824] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:40.747493 1997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb: No bootstrap required, opened a new log
W20260806 00:57:40.746927 2021 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 00:57:40.748737 2021 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:57:40.749189 1997 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } }
I20260806 00:57:40.749315 1997 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4c4aadca566442a88a18753c1bccdeb, State: Initialized, Role: FOLLOWER
I20260806 00:57:40.749387 1997 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } }
I20260806 00:57:40.749660 1997 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:40.750517 1913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.741448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44628 (local address 127.3.98.189:41689)
0806 00:57:40.741538 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.741539 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.741548 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:57:40.741569 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.741570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.741580 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.741646 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.742343 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.742786 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.743668 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.743878 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.743965 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.747128 (+ 3163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.747129 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.747129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.747137 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.748960 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.749355 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.749356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.749356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.749410 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.749610 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.749610 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.749611 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.749756 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.750304 (+ 548us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.750348 (+ 44us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.750429 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 00:57:40.749115 1715 master_runner.cc:186] Error getting master registration for 127.3.98.189:41689: OK, instance_id { permanent_uuid: "5f45ac704383432881193433b560a450" instance_seqno: 1785977860545620 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 00:57:40.752135 1715 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 00:57:40.753567 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:40.754511 1772 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9fca3e927de34443a51584cf87250f52"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40104
I20260806 00:57:40.754627 1772 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 00:57:40.754670 1772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:40.755594 1772 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } }
I20260806 00:57:40.755795 1772 leader_election.cc:288] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [CANDIDATE]: Term 1 election: Requested vote from peers 5f45ac704383432881193433b560a450 (127.3.98.189:41689), f4c4aadca566442a88a18753c1bccdeb (127.3.98.188:39313)
I20260806 00:57:40.756686 1967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9fca3e927de34443a51584cf87250f52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f4c4aadca566442a88a18753c1bccdeb"
I20260806 00:57:40.756801 1967 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:40.757771 1967 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fca3e927de34443a51584cf87250f52 in term 1.
I20260806 00:57:40.757962 1741 leader_election.cc:302] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fca3e927de34443a51584cf87250f52, f4c4aadca566442a88a18753c1bccdeb; no voters:
I20260806 00:57:40.758105 2008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:40.758291 2008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [term 1 LEADER]: Becoming Leader. State: Replica: 9fca3e927de34443a51584cf87250f52, State: Running, Role: LEADER
I20260806 00:57:40.758375 2008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } }
I20260806 00:57:40.754535 1916 master_runner.cc:186] Error getting master registration for 127.3.98.189:41689: OK, instance_id { permanent_uuid: "5f45ac704383432881193433b560a450" instance_seqno: 1785977860545620 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 00:57:40.758471 1916 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 00:57:40.751449 2027 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } } }
W20260806 00:57:40.751590 2042 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260806 00:57:40.758538 2027 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb [sys.catalog]: This master's current role is: FOLLOWER
W20260806 00:57:40.758556 2042 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:57:40.758880 2008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fca3e927de34443a51584cf87250f52. Latest consensus state: current_term: 1 leader_uuid: "9fca3e927de34443a51584cf87250f52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } } }
I20260806 00:57:40.758968 2008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:40.759935 2051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:40.760560 2051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:40.771956 1808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.757586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40120 (local address 127.3.98.190:39917)
0806 00:57:40.757632 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.757634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.760690 (+ 3056us) server_negotiation.cc:407] Connection header received
0806 00:57:40.760797 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.760798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.760809 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.760838 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.762276 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.762956 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.765063 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.765343 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.765404 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.768010 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.768011 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.768012 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.768019 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.769868 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.770931 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.770932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.770932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.770996 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.771213 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.771214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.771215 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.771365 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.771464 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.771757 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.771840 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 00:57:40.773620 1913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.759503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44638 (local address 127.3.98.189:41689)
0806 00:57:40.759550 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.759552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.760293 (+ 741us) server_negotiation.cc:407] Connection header received
0806 00:57:40.760383 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.760384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.760396 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.760470 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.761734 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.762458 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.763929 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.764255 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.764297 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.769769 (+ 5472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.769770 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.769771 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.769779 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.772014 (+ 2235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.772472 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.772474 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.772474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.772563 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.772824 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.772826 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.772826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.772982 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.773091 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.773384 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.773500 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:57:40.773739 1967 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb [term 1 FOLLOWER]: Refusing update from remote peer 9fca3e927de34443a51584cf87250f52: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:40.774137 2049 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:40.775714 2027 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fca3e927de34443a51584cf87250f52. Latest consensus state: current_term: 1 leader_uuid: "9fca3e927de34443a51584cf87250f52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } } }
I20260806 00:57:40.776005 2000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.759683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58778 (local address 127.3.98.188:39313)
0806 00:57:40.759757 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.759759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.763987 (+ 4228us) server_negotiation.cc:407] Connection header received
0806 00:57:40.764079 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.764080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.764090 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.764118 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.765038 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.765744 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.766966 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.767267 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.767336 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.772347 (+ 5011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.772349 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.772349 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.772373 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.774436 (+ 2063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.774871 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.774872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.774873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.774930 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.775132 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.775133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.775133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.775270 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.775349 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.775587 (+ 238us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.775671 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 00:57:40.775833 2027 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:57:40.777518 2055 mvcc.cc:205] Tried to move back new op lower bound from 7315365317725773824 to 7315365317667155968. Current Snapshot: MvccSnapshot[applied={T|T < 7315365317725773824}]
I20260806 00:57:40.777599 2008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9fca3e927de34443a51584cf87250f52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } } }
I20260806 00:57:40.777696 2008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:40.777694 2027 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9fca3e927de34443a51584cf87250f52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } } }
I20260806 00:57:40.777760 2027 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:57:40.778026 2058 mvcc.cc:205] Tried to move back new op lower bound from 7315365317725773824 to 7315365317667155968. Current Snapshot: MvccSnapshot[applied={T|T < 7315365317725773824}]
I20260806 00:57:40.779480 2051 catalog_manager.cc:1347] Generated new cluster ID: 7e1b06960f344ef7b6ccc8c3a0d15670
I20260806 00:57:40.779531 2051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:40.781243 1905 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } attempt: 3
Aug 06 00:57:40 dist-test-slave-44d2 krb5kdc[1693](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977860, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.189@KRBTEST.COM for kudu/127.3.98.188@KRBTEST.COM
I20260806 00:57:40.789609 1909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.781463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:39313 (local address 127.0.0.1:58786)
0806 00:57:40.781545 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:40.781554 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:40.781588 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:40.781857 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:40.781858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:40.782008 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:40.782049 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.782051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.782970 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.782971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.783760 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:40.783761 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.784259 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.784260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:40.784324 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.784860 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:40.784865 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:40.786342 (+ 1477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:40.788326 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.788327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.788327 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.788583 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.788861 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:40.788861 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:40.788862 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:40.788943 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:40.789284 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:40.789285 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:40.789344 (+ 59us) client_negotiation.cc:769] Sending connection context
0806 00:57:40.789405 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 00:57:40.789508 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 00:57:40.790087 2000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:40.781686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58786 (local address 127.3.98.188:39313)
0806 00:57:40.781718 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.781720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.781725 (+ 5us) server_negotiation.cc:407] Connection header received
0806 00:57:40.781742 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.781743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.781752 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.781794 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.782173 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.782879 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.783847 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:40.784139 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:40.784196 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:40.786442 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:40.786443 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:40.786443 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:40.786468 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:40.788224 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.788684 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.788685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.788685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.788767 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:40.789032 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:40.789033 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:40.789033 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:40.789176 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:40.789236 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:40.789937 (+ 701us) server_negotiation.cc:299] Negotiation successful
0806 00:57:40.790006 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 00:57:40.791918 1905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450: Bootstrap starting.
I20260806 00:57:40.792737 1905 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:40.793081 1905 log.cc:824] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:40.794052 1905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450: No bootstrap required, opened a new log
I20260806 00:57:40.796207 1905 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } }
I20260806 00:57:40.796353 1905 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f45ac704383432881193433b560a450, State: Initialized, Role: FOLLOWER
I20260806 00:57:40.796438 1905 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } }
I20260806 00:57:40.797272 1905 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:40.797348 1865 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:40.798359 1865 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450 [term 1 FOLLOWER]: Refusing update from remote peer 9fca3e927de34443a51584cf87250f52: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:40.798725 2049 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:40.799105 1866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9fca3e927de34443a51584cf87250f52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5f45ac704383432881193433b560a450"
I20260806 00:57:40.799898 1866 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fca3e927de34443a51584cf87250f52 in term 1.
W20260806 00:57:40.805526 2079 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 00:57:40.805593 2079 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:57:40.806263 2051 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:40.806478 2008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9fca3e927de34443a51584cf87250f52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } } }
I20260806 00:57:40.806571 2008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:40.807008 2051 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:40.809814 2083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9fca3e927de34443a51584cf87250f52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } } }
I20260806 00:57:40.809911 2083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:57:40.809969 2083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fca3e927de34443a51584cf87250f52. Latest consensus state: current_term: 1 leader_uuid: "9fca3e927de34443a51584cf87250f52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } } }
I20260806 00:57:40.810043 2083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:57:40.810082 2083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9fca3e927de34443a51584cf87250f52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fca3e927de34443a51584cf87250f52" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 39917 } } peers { permanent_uuid: "5f45ac704383432881193433b560a450" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 41689 } } peers { permanent_uuid: "f4c4aadca566442a88a18753c1bccdeb" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 39313 } } }
I20260806 00:57:40.810132 2083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:57:40.811532 2081 mvcc.cc:205] Tried to move back new op lower bound from 7315365317725773824 to 7315365317667155968. Current Snapshot: MvccSnapshot[applied={T|T < 7315365317725773824}]
I20260806 00:57:40.812232 2051 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9fca3e927de34443a51584cf87250f52: Generated new TSK 0
I20260806 00:57:40.812426 2051 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 00:57:40.846179 1808 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:40.844521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40134 (local address 127.3.98.190:39917)
0806 00:57:40.844572 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.844574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.845484 (+ 910us) server_negotiation.cc:407] Connection header received
0806 00:57:40.845597 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.845598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.845609 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.845639 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.846104 (+ 465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40134: BlockingRecv error: recv got EOF from 127.0.0.1:40134 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260806 00:57:40.846925 1913 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:40.844909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44642 (local address 127.3.98.189:41689)
0806 00:57:40.844975 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.844977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.846430 (+ 1453us) server_negotiation.cc:407] Connection header received
0806 00:57:40.846529 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.846531 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.846542 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.846570 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.846864 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44642: BlockingRecv error: recv got EOF from 127.0.0.1:44642 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260806 00:57:40.847662 2000 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:40.845199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58796 (local address 127.3.98.188:39313)
0806 00:57:40.845247 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.845249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.847161 (+ 1912us) server_negotiation.cc:407] Connection header received
0806 00:57:40.847264 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.847265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.847276 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.847304 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.847603 (+ 299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58796: BlockingRecv error: recv got EOF from 127.0.0.1:58796 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260806 00:57:40.850167 1913 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:40.849369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44646 (local address 127.3.98.189:41689)
0806 00:57:40.849436 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.849437 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.849628 (+ 191us) server_negotiation.cc:407] Connection header received
0806 00:57:40.849734 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.849735 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.849753 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.849780 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.850110 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44646: BlockingRecv error: recv got EOF from 127.0.0.1:44646 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260806 00:57:40.853286 1913 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:40.852451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44648 (local address 127.3.98.189:41689)
0806 00:57:40.852566 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.852568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.852801 (+ 233us) server_negotiation.cc:407] Connection header received
0806 00:57:40.852893 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.852894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.852904 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.852931 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.853244 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44648: BlockingRecv error: recv got EOF from 127.0.0.1:44648 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260806 00:57:40.857240 1913 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:40.856360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44656 (local address 127.3.98.189:41689)
0806 00:57:40.856393 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.856394 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.856681 (+ 287us) server_negotiation.cc:407] Connection header received
0806 00:57:40.856832 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.856833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.856843 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.856871 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.857199 (+ 328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44656: BlockingRecv error: recv got EOF from 127.0.0.1:44656 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260806 00:57:40.865891 1913 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:40.864783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44670 (local address 127.3.98.189:41689)
0806 00:57:40.865110 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.865112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.865350 (+ 238us) server_negotiation.cc:407] Connection header received
0806 00:57:40.865452 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.865453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.865464 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.865494 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.865841 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44670: BlockingRecv error: recv got EOF from 127.0.0.1:44670 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260806 00:57:40.876049 1913 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:40.875122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44686 (local address 127.3.98.189:41689)
0806 00:57:40.875164 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.875166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.875456 (+ 290us) server_negotiation.cc:407] Connection header received
0806 00:57:40.875563 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.875564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.875576 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.875607 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.875979 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44686: BlockingRecv error: recv got EOF from 127.0.0.1:44686 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260806 00:57:40.894693 1913 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:40.893446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44694 (local address 127.3.98.189:41689)
0806 00:57:40.893569 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.893572 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.894046 (+ 474us) server_negotiation.cc:407] Connection header received
0806 00:57:40.894161 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.894163 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.894176 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.894207 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.894629 (+ 422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44694: BlockingRecv error: recv got EOF from 127.0.0.1:44694 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260806 00:57:40.929466 1913 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:40.928203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44702 (local address 127.3.98.189:41689)
0806 00:57:40.928250 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.928252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.928669 (+ 417us) server_negotiation.cc:407] Connection header received
0806 00:57:40.928790 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.928792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.928807 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.928858 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.929398 (+ 540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44702: BlockingRecv error: recv got EOF from 127.0.0.1:44702 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260806 00:57:40.996116 1913 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:40.995213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44718 (local address 127.3.98.189:41689)
0806 00:57:40.995273 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:40.995276 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:40.995411 (+ 135us) server_negotiation.cc:407] Connection header received
0806 00:57:40.995451 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:40.995452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:40.995466 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:40.995561 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:40.996047 (+ 486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44718: BlockingRecv error: recv got EOF from 127.0.0.1:44718 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260806 00:57:41.126226 1913 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:41.125407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44730 (local address 127.3.98.189:41689)
0806 00:57:41.125502 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:41.125504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:41.125621 (+ 117us) server_negotiation.cc:407] Connection header received
0806 00:57:41.125715 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:41.125716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:41.125729 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:41.125781 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:41.126156 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44730: BlockingRecv error: recv got EOF from 127.0.0.1:44730 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260806 00:57:41.384320 1913 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:41.383622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44744 (local address 127.3.98.189:41689)
0806 00:57:41.383686 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:41.383688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:41.383699 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:57:41.383754 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:41.383755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:41.383767 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:41.383851 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:41.384243 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44744: BlockingRecv error: recv got EOF from 127.0.0.1:44744 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260806 00:57:41.759029 2042 catalog_manager.cc:1259] Loaded cluster ID: 7e1b06960f344ef7b6ccc8c3a0d15670
I20260806 00:57:41.759112 2042 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb: loading cluster ID for follower catalog manager: success
I20260806 00:57:41.759980 2042 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb: acquiring CA information for follower catalog manager: success
I20260806 00:57:41.760325 2042 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f4c4aadca566442a88a18753c1bccdeb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 00:57:41.806173 2079 catalog_manager.cc:1259] Loaded cluster ID: 7e1b06960f344ef7b6ccc8c3a0d15670
I20260806 00:57:41.806264 2079 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450: loading cluster ID for follower catalog manager: success
I20260806 00:57:41.807083 2079 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450: acquiring CA information for follower catalog manager: success
I20260806 00:57:41.807360 2079 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5f45ac704383432881193433b560a450: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 00:57:41.900403 2185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:41.897519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44758 (local address 127.3.98.189:41689)
0806 00:57:41.897717 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:41.897719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:41.897730 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:57:41.897828 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:41.897829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:41.897885 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:41.897982 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:41.898150 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:41.898654 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:41.899478 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:41.899685 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:41.899743 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:41.899960 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:41.900085 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:41.900160 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:41.900195 (+ 35us) server_negotiation.cc:299] Negotiation successful
0806 00:57:41.900216 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":122,"threads_started":1}
I20260806 00:57:41.905078 2193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:41.902612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58798 (local address 127.3.98.188:39313)
0806 00:57:41.902721 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:41.902723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:41.902730 (+ 7us) server_negotiation.cc:407] Connection header received
0806 00:57:41.902766 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:41.902767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:41.902806 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:41.902882 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:41.903060 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:41.903527 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:41.904265 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:41.904453 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:41.904578 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:41.904719 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:41.904824 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:41.904884 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:41.904922 (+ 38us) server_negotiation.cc:299] Negotiation successful
0806 00:57:41.904940 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":61,"threads_started":1}
I20260806 00:57:41.909878 2201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:41.906824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40138 (local address 127.3.98.190:39917)
0806 00:57:41.906952 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:41.906954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:41.906965 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:57:41.907014 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:41.907015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:41.907073 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:41.907167 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:41.907344 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:41.907967 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:41.908885 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:41.909201 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:41.909271 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:41.909498 (+ 227us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:41.909592 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:41.909672 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:41.909739 (+ 67us) server_negotiation.cc:299] Negotiation successful
0806 00:57:41.909763 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":77,"threads_started":1}
I20260806 00:57:41.910310 2193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:41.907255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58806 (local address 127.3.98.188:39313)
0806 00:57:41.907303 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:41.907305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:41.907375 (+ 70us) server_negotiation.cc:407] Connection header received
0806 00:57:41.907440 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:41.907441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:41.907451 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:41.907494 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:41.907665 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:41.908355 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:41.909349 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:41.909668 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:41.909743 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:41.910042 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:41.910064 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:41.910131 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:41.910219 (+ 88us) server_negotiation.cc:299] Negotiation successful
0806 00:57:41.910244 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 00:57:41.910364 2185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:41.906976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44768 (local address 127.3.98.189:41689)
0806 00:57:41.907040 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:41.907042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:41.907148 (+ 106us) server_negotiation.cc:407] Connection header received
0806 00:57:41.907269 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:41.907270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:41.907282 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:41.907342 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:41.907531 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:41.908281 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:41.909394 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:41.909695 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:41.909734 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:41.909914 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:41.909952 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:41.909998 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:41.910263 (+ 265us) server_negotiation.cc:299] Negotiation successful
0806 00:57:41.910287 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 00:57:41.912017 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 1715
I20260806 00:57:41.926849 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 1813
I20260806 00:57:41.937556 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 1916
2026-08-06T00:57:41Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3111 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 00:57:41 dist-test-slave-44d2 krb5kdc[2206](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 00:57:41 dist-test-slave-44d2 krb5kdc[2206](info): set up 2 sockets
Aug 06 00:57:41 dist-test-slave-44d2 krb5kdc[2206](info): commencing operation
krb5kdc: starting...
W20260806 00:57:43.350649 3466 mini_kdc.cc:121] Time spent starting KDC: real 1.389s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/test-user.keytab.
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T00:57:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T00:57:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.98.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
Entry for principal kudu/127.3.98.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab.
I20260806 00:57:43.479332 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:32843
--webserver_interface=127.3.98.190
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:36693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:32843,127.3.98.189:43475,127.3.98.188:41283
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 00:57:43.569851 2224 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 00:57:43.570091 2224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:43.570109 2224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:43.570132 2224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:43.571259 2224 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:43.571295 2224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:43.571308 2224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:43.571321 2224 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:43.571332 2224 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:43.572810 2224 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:32843,127.3.98.189:43475,127.3.98.188:41283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.190.keytab
--principal=kudu/127.3.98.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.190:32843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.98.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:43.573019 2224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:43.573186 2224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:43.578051 2232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:43.578172 2229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:43.578186 2230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:43.578320 2224 server_base.cc:1034] running on GCE node
I20260806 00:57:43.578531 2224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:43.578778 2224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:43.579937 2224 hybrid_clock.cc:648] HybridClock initialized: now 1785977863579927 us; error 32 us; skew 500 ppm
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:43.582741 2224 init.cc:377] Logged in from keytab as kudu/127.3.98.190@KRBTEST.COM (short username kudu)
I20260806 00:57:43.583242 2224 webserver.cc:460] Webserver started at http://127.3.98.190:45951/ using document root <none> and password file <none>
I20260806 00:57:43.583436 2224 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:43.583477 2224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:43.583573 2224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:43.584717 2224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/data/instance:
uuid: "3649fc1076c849099d0d02ebdae76e80"
format_stamp: "Formatted at 2026-08-06 00:57:43 on dist-test-slave-44d2"
server_key: "937d40e29cf88d85bac790c270e9cad0"
server_key_iv: "e21b089d5bc19e16fecf1d929332cf54"
server_key_version: "encryptionkey@0"
I20260806 00:57:43.585031 2224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/wal/instance:
uuid: "3649fc1076c849099d0d02ebdae76e80"
format_stamp: "Formatted at 2026-08-06 00:57:43 on dist-test-slave-44d2"
server_key: "937d40e29cf88d85bac790c270e9cad0"
server_key_iv: "e21b089d5bc19e16fecf1d929332cf54"
server_key_version: "encryptionkey@0"
I20260806 00:57:43.586306 2224 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 00:57:43.586998 2243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:43.587215 2224 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:43.587302 2224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/wal
uuid: "3649fc1076c849099d0d02ebdae76e80"
format_stamp: "Formatted at 2026-08-06 00:57:43 on dist-test-slave-44d2"
server_key: "937d40e29cf88d85bac790c270e9cad0"
server_key_iv: "e21b089d5bc19e16fecf1d929332cf54"
server_key_version: "encryptionkey@0"
I20260806 00:57:43.587359 2224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:43.607435 2224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:43.609488 2224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:43.609618 2224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:43.613569 2224 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.190:32843
I20260806 00:57:43.613621 2319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.190:32843 every 8 connection(s)
I20260806 00:57:43.613969 2224 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/data/info.pb
I20260806 00:57:43.614960 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 2224
I20260806 00:57:43.615070 2320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:43.615069 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-0/wal/instance
I20260806 00:57:43.615324 3466 external_mini_cluster.cc:1428] Setting key b9576ac8b6d2a7af90edbae85ac3e0fa
I20260806 00:57:43.616832 2320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.98.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.189@KRBTEST.COM" created.
I20260806 00:57:43.627414 2325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.617843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53314 (local address 127.3.98.190:32843)
0806 00:57:43.618430 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:43.618436 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:43.618474 (+ 38us) server_negotiation.cc:407] Connection header received
0806 00:57:43.618750 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:43.618752 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:43.618777 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:43.618875 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:43.619427 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.620251 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.621223 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.621537 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.621666 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.623815 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:43.623823 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:43.623824 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:43.623831 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:43.625571 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.625949 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.625951 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.625951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.626035 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.626390 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.626390 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.626390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.626630 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:43.626693 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:43.626974 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 00:57:43.627145 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":544,"thread_start_us":41,"threads_started":1}
I20260806 00:57:43.627416 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.617692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:32843 (local address 127.0.0.1:53314)
0806 00:57:43.617862 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.617911 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:43.618588 (+ 677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:43.618880 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:43.618883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:43.619162 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:43.619313 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.619318 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.620355 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.620356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.621117 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.621119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.621647 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.621648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.621712 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.622274 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:43.622284 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:43.623727 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:43.625655 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.625663 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.625665 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.625866 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.626159 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.626160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.626161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.626325 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.626707 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:43.626741 (+ 34us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:43.626825 (+ 84us) client_negotiation.cc:769] Sending connection context
0806 00:57:43.626907 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 00:57:43.627211 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":140,"thread_start_us":66,"threads_started":1}
I20260806 00:57:43.628305 2320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:57:43.628710 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.628596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:43475 (local address 127.0.0.1:37404)
0806 00:57:43.628645 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.628691 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 00:57:43.628886 2244 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.98.189:43475: connect: Connection refused (error 111)
I20260806 00:57:43.629374 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.629271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:43475 (local address 127.0.0.1:37418)
0806 00:57:43.629325 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.629350 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 00:57:43.629487 2320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.189:43475: Network error: Client connection negotiation failed: client connection to 127.3.98.189:43475: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.189.keytab.
Entry for principal kudu/127.3.98.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.189.keytab.
I20260806 00:57:43.643297 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.189:43475
--webserver_interface=127.3.98.189
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.189.keytab
--principal=kudu/127.3.98.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:36693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:32843,127.3.98.189:43475,127.3.98.188:41283
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:57:43.678702 2320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } attempt: 1
I20260806 00:57:43.679216 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.679076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:43475 (local address 127.0.0.1:37432)
0806 00:57:43.679143 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.679186 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 00:57:43.679610 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.679510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:43475 (local address 127.0.0.1:37446)
0806 00:57:43.679558 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.679585 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 00:57:43.679699 2320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.189:43475: Network error: Client connection negotiation failed: client connection to 127.3.98.189:43475: connect: Connection refused (error 111)
W20260806 00:57:43.728297 2332 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 00:57:43.728549 2332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:43.728606 2332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:43.728638 2332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:43.729779 2332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:43.729821 2332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:43.729835 2332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:43.729889 2332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:43.729907 2332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:43.731383 2332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:32843,127.3.98.189:43475,127.3.98.188:41283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.189.keytab
--principal=kudu/127.3.98.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.189:43475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.3.98.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:43.731650 2332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:43.731881 2332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 00:57:43.737128 2332 server_base.cc:1034] running on GCE node
W20260806 00:57:43.737094 2340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:43.737084 2341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:43.737100 2345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:43.737558 2332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:43.737911 2332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:43.739082 2332 hybrid_clock.cc:648] HybridClock initialized: now 1785977863739070 us; error 45 us; skew 500 ppm
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:43.741734 2332 init.cc:377] Logged in from keytab as kudu/127.3.98.189@KRBTEST.COM (short username kudu)
I20260806 00:57:43.742192 2332 webserver.cc:460] Webserver started at http://127.3.98.189:36325/ using document root <none> and password file <none>
I20260806 00:57:43.742440 2332 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:43.742512 2332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:43.742669 2332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:43.743743 2332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/data/instance:
uuid: "99d0401eb956449ebbbc653426106e1f"
format_stamp: "Formatted at 2026-08-06 00:57:43 on dist-test-slave-44d2"
server_key: "91b1508d207e301ffa72ee0a7b88e927"
server_key_iv: "c3aa5e72c0ad522541fc977d333cab07"
server_key_version: "encryptionkey@0"
I20260806 00:57:43.744421 2332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/wal/instance:
uuid: "99d0401eb956449ebbbc653426106e1f"
format_stamp: "Formatted at 2026-08-06 00:57:43 on dist-test-slave-44d2"
server_key: "91b1508d207e301ffa72ee0a7b88e927"
server_key_iv: "c3aa5e72c0ad522541fc977d333cab07"
server_key_version: "encryptionkey@0"
I20260806 00:57:43.745811 2332 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 00:57:43.746563 2354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:43.746735 2332 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:43.746829 2332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/wal
uuid: "99d0401eb956449ebbbc653426106e1f"
format_stamp: "Formatted at 2026-08-06 00:57:43 on dist-test-slave-44d2"
server_key: "91b1508d207e301ffa72ee0a7b88e927"
server_key_iv: "c3aa5e72c0ad522541fc977d333cab07"
server_key_version: "encryptionkey@0"
I20260806 00:57:43.746912 2332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:43.747834 2320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } attempt: 2
I20260806 00:57:43.748203 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.748082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:43475 (local address 127.0.0.1:37450)
0806 00:57:43.748142 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.748177 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 00:57:43.748564 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.748444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:43475 (local address 127.0.0.1:37454)
0806 00:57:43.748517 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.748547 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.189:43475: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 00:57:43.748651 2320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.189:43475: Network error: Client connection negotiation failed: client connection to 127.3.98.189:43475: connect: Connection refused (error 111)
I20260806 00:57:43.780547 2332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:43.783110 2332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:43.783274 2332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:43.787426 2332 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.189:43475
I20260806 00:57:43.787494 2425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.189:43475 every 8 connection(s)
I20260806 00:57:43.787855 2332 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/data/info.pb
I20260806 00:57:43.788980 2426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:43.789155 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 2332
I20260806 00:57:43.789280 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-1/wal/instance
I20260806 00:57:43.789508 3466 external_mini_cluster.cc:1428] Setting key bb9b7aa70a541a35d058c42051a2c30d
I20260806 00:57:43.790877 2426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.189@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.98.188@KRBTEST.COM; defaulting to no policy
I20260806 00:57:43.800420 2325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.791685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53326 (local address 127.3.98.190:32843)
0806 00:57:43.791760 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:43.791763 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:43.792026 (+ 263us) server_negotiation.cc:407] Connection header received
0806 00:57:43.792810 (+ 784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:43.792811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:43.792829 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:43.792882 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:43.793522 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.794093 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.795099 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.795321 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.795411 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.797660 (+ 2249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:43.797662 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:43.797663 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:43.797671 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:43.799020 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.799428 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.799429 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.799429 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.799492 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.799756 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.799757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.799757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.799876 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:43.799947 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:43.800238 (+ 291us) server_negotiation.cc:299] Negotiation successful
0806 00:57:43.800327 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 00:57:43.800625 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.791670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:32843 (local address 127.0.0.1:53326)
0806 00:57:43.791870 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.791924 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:43.792682 (+ 758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:43.792956 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:43.792960 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:43.793217 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:43.793412 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.793416 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.794189 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.794190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.794994 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.794995 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.795434 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.795435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.795572 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.796146 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:43.796155 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:43.797557 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:43.799107 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.799115 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.799117 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.799348 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.799568 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.799568 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.799569 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.799678 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.799950 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:43.799958 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:43.800099 (+ 141us) client_negotiation.cc:769] Sending connection context
0806 00:57:43.800205 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 00:57:43.800364 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":100,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.98.188@KRBTEST.COM" created.
I20260806 00:57:43.801239 2426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.189@KRBTEST.COM for kudu/127.3.98.189@KRBTEST.COM
I20260806 00:57:43.809432 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.801506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:43475 (local address 127.0.0.1:37464)
0806 00:57:43.801573 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.801584 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:43.801626 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:43.801928 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:43.801929 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:43.802060 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:43.802111 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.802112 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.803170 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.803171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.803890 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.803892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.804634 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.804635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.804692 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.805108 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:43.805112 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:43.806227 (+ 1115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:43.808289 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.808290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.808290 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.808452 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.808788 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.808789 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.808789 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.808845 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.809206 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:43.809207 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:43.809240 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 00:57:43.809290 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 00:57:43.809369 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 00:57:43.809566 2430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.801583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37464 (local address 127.3.98.189:43475)
0806 00:57:43.801759 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:43.801764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:43.801789 (+ 25us) server_negotiation.cc:407] Connection header received
0806 00:57:43.801815 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:43.801817 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:43.801832 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:43.801919 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:43.802190 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.803073 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.803979 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.804555 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.804639 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.806316 (+ 1677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:43.806326 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:43.806327 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:43.806335 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:43.808195 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.808636 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.808640 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.808640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.808709 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.808916 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.808917 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.808917 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.809131 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:43.809230 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:43.809333 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 00:57:43.809451 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":141,"thread_start_us":90,"threads_started":1}
I20260806 00:57:43.810163 2426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:57:43.810544 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.810378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40508)
0806 00:57:43.810422 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.810489 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 00:57:43.810703 2359 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
I20260806 00:57:43.811298 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.811184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40520)
0806 00:57:43.811244 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.811276 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260806 00:57:43.811470 2426 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:41283: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.98.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.188.keytab.
Entry for principal kudu/127.3.98.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.188.keytab.
I20260806 00:57:43.819337 3466 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksA1zh9/build/release/bin/kudu
/tmp/dist-test-tasksA1zh9/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.188:41283
--webserver_interface=127.3.98.188
--webserver_port=0
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.188.keytab
--principal=kudu/127.3.98.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.98.148:36693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.98.190:32843,127.3.98.189:43475,127.3.98.188:41283
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 00:57:43.839805 2320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } attempt: 3
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for kudu/127.3.98.189@KRBTEST.COM
I20260806 00:57:43.847337 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.840182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:43475 (local address 127.0.0.1:37476)
0806 00:57:43.840257 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.840276 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:43.840347 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:43.840547 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:43.840548 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:43.840719 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:43.840790 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.840792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.841507 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.841509 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.842069 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.842071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.842472 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.842473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.842560 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.843044 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:43.843049 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:43.844300 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:43.846261 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.846262 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.846263 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.846441 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.846667 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.846668 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.846668 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.846731 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.846995 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:43.846997 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:43.847046 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 00:57:43.847125 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 00:57:43.847230 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 00:57:43.847337 2430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.840269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37476 (local address 127.3.98.189:43475)
0806 00:57:43.840344 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:43.840346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:43.840358 (+ 12us) server_negotiation.cc:407] Connection header received
0806 00:57:43.840417 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:43.840419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:43.840432 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:43.840538 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:43.840876 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.841406 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.842159 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.842392 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.842475 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.844392 (+ 1917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:43.844394 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:43.844394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:43.844402 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:43.846171 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.846532 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.846534 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.846534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.846597 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.846796 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.846797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.846798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.846919 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:43.846994 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:43.847164 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 00:57:43.847242 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 00:57:43.847724 2320 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:57:43.848083 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.847980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40524)
0806 00:57:43.848030 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.848059 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260806 00:57:43.848555 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.848415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40534)
0806 00:57:43.848458 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.848532 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 00:57:43.848672 2320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:41283: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
I20260806 00:57:43.860684 2426 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } attempt: 1
I20260806 00:57:43.861068 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.860943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40540)
0806 00:57:43.860996 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.861044 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260806 00:57:43.861433 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.861340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40544)
0806 00:57:43.861386 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.861409 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 00:57:43.861542 2426 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:41283: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
I20260806 00:57:43.879818 2320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } attempt: 1
I20260806 00:57:43.880254 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.880126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40558)
0806 00:57:43.880189 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.880228 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 00:57:43.880657 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.880562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40566)
0806 00:57:43.880606 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.880633 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260806 00:57:43.880748 2320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:41283: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
W20260806 00:57:43.912932 2433 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 00:57:43.913198 2433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 00:57:43.913232 2433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 00:57:43.913280 2433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 00:57:43.914530 2433 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 00:57:43.914605 2433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 00:57:43.914635 2433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 00:57:43.914672 2433 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 00:57:43.914700 2433 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 00:57:43.916467 2433 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.98.148:36693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.3.98.190:32843,127.3.98.189:43475,127.3.98.188:41283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/krb5kdc/kudu_127.3.98.188.keytab
--principal=kudu/127.3.98.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.98.188:41283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.3.98.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 00:03:48 UTC on ccycloud.quasar-tjopyd.root.comops.site
build id 4569412
I20260806 00:57:43.916817 2433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 00:57:43.917081 2433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 00:57:43.922449 2444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:43.922528 2439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 00:57:43.922449 2440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 00:57:43.922662 2433 server_base.cc:1034] running on GCE node
I20260806 00:57:43.922956 2433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 00:57:43.923214 2433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 00:57:43.924362 2433 hybrid_clock.cc:648] HybridClock initialized: now 1785977863924341 us; error 36 us; skew 500 ppm
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 00:57:43.927080 2433 init.cc:377] Logged in from keytab as kudu/127.3.98.188@KRBTEST.COM (short username kudu)
I20260806 00:57:43.927532 2433 webserver.cc:460] Webserver started at http://127.3.98.188:36615/ using document root <none> and password file <none>
I20260806 00:57:43.927784 2433 fs_manager.cc:359] Metadata directory not provided
I20260806 00:57:43.927857 2433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 00:57:43.928017 2433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 00:57:43.929168 2433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/data/instance:
uuid: "320e53c568244691b3de773e0b1e5415"
format_stamp: "Formatted at 2026-08-06 00:57:43 on dist-test-slave-44d2"
server_key: "40970930ff0448d4d18b46ac6a5fcc38"
server_key_iv: "97feeacad05b4dd5a4fa64f6e5efe9d6"
server_key_version: "encryptionkey@0"
I20260806 00:57:43.929538 2433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/wal/instance:
uuid: "320e53c568244691b3de773e0b1e5415"
format_stamp: "Formatted at 2026-08-06 00:57:43 on dist-test-slave-44d2"
server_key: "40970930ff0448d4d18b46ac6a5fcc38"
server_key_iv: "97feeacad05b4dd5a4fa64f6e5efe9d6"
server_key_version: "encryptionkey@0"
I20260806 00:57:43.929677 2426 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } attempt: 2
I20260806 00:57:43.930083 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.929936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40572)
0806 00:57:43.930003 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.930039 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 00:57:43.930467 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.930382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40576)
0806 00:57:43.930427 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.930451 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 00:57:43.930603 2426 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:41283: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
I20260806 00:57:43.931290 2433 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 00:57:43.932052 2454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 00:57:43.932245 2433 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 00:57:43.932349 2433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/data,/tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/wal
uuid: "320e53c568244691b3de773e0b1e5415"
format_stamp: "Formatted at 2026-08-06 00:57:43 on dist-test-slave-44d2"
server_key: "40970930ff0448d4d18b46ac6a5fcc38"
server_key_iv: "97feeacad05b4dd5a4fa64f6e5efe9d6"
server_key_version: "encryptionkey@0"
I20260806 00:57:43.932435 2433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 00:57:43.952683 2433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 00:57:43.954676 2433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 00:57:43.954849 2433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 00:57:43.955904 2320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } attempt: 2
I20260806 00:57:43.956359 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.956216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40590)
0806 00:57:43.956283 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.956325 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 00:57:43.956894 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.956764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40606)
0806 00:57:43.956817 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.956846 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260806 00:57:43.957003 2320 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.98.188:41283: Network error: Client connection negotiation failed: client connection to 127.3.98.188:41283: connect: Connection refused (error 111)
I20260806 00:57:43.959329 2433 rpc_server.cc:307] RPC server started. Bound to: 127.3.98.188:41283
I20260806 00:57:43.959383 2527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.98.188:41283 every 8 connection(s)
I20260806 00:57:43.959753 2433 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/data/info.pb
I20260806 00:57:43.960886 2529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 00:57:43.962508 2529 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:57:43.965934 3466 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksA1zh9/build/release/bin/kudu as pid 2433
I20260806 00:57:43.966050 3466 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksA1zh9/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785977579314977-3466-0/minicluster-data/master-2/wal/instance
I20260806 00:57:43.966259 3466 external_mini_cluster.cc:1428] Setting key 6abd231ad52e62fefba16c864075e612
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.188@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.188@KRBTEST.COM
I20260806 00:57:43.972460 2325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.963189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53332 (local address 127.3.98.190:32843)
0806 00:57:43.963233 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:43.963235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:43.963485 (+ 250us) server_negotiation.cc:407] Connection header received
0806 00:57:43.964012 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:43.964014 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:43.964026 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:43.964093 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:43.964804 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.965283 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.966635 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.966924 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.966999 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.969575 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:43.969577 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:43.969577 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:43.969585 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:43.970983 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.971429 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.971430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.971430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.971491 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.971757 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.971758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.971758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.971875 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:43.971955 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:43.972282 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 00:57:43.972370 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 00:57:43.972741 2531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.963169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.190:32843 (local address 127.0.0.1:53332)
0806 00:57:43.963362 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.963398 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:43.963892 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:43.964176 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:43.964180 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:43.964436 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:43.964706 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.964711 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.965397 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.965398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.966542 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.966544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.967036 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.967038 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.967191 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.967766 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:43.967774 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:43.969476 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:43.971102 (+ 1626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.971110 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.971112 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.971339 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.971569 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.971570 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.971570 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.971680 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.971947 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:43.971955 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:43.972118 (+ 163us) client_negotiation.cc:769] Sending connection context
0806 00:57:43.972246 (+ 128us) client_negotiation.cc:240] Negotiation successful
0806 00:57:43.972398 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":81,"threads_started":1}
I20260806 00:57:43.973371 2529 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:57:43.975648 2535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.966637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40614 (local address 127.3.98.188:41283)
0806 00:57:43.966830 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:43.966833 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:43.966892 (+ 59us) server_negotiation.cc:407] Connection header received
0806 00:57:43.966952 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:43.966954 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:43.967000 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:43.967090 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:43.967859 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.968796 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.969637 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.970069 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.970146 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.972457 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:43.972465 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:43.972466 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:43.972472 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:43.974463 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.974851 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.974854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.974854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.974903 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.975100 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.975100 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.975101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.975253 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:43.975419 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:43.975463 (+ 44us) server_negotiation.cc:299] Negotiation successful
0806 00:57:43.975549 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":93,"threads_started":1}
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.188@KRBTEST.COM for kudu/127.3.98.189@KRBTEST.COM
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.190@KRBTEST.COM
I20260806 00:57:43.980824 2531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.973715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.189:43475 (local address 127.0.0.1:37482)
0806 00:57:43.973856 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.973867 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:43.973921 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:43.974043 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:43.974044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:43.974251 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:43.974291 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.974293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.975107 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.975108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.975823 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.975826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.976290 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.976291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.976381 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.976821 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:43.976828 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:43.978077 (+ 1249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:43.979789 (+ 1712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.979790 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.979791 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.979964 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.980200 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.980201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.980202 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.980255 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.980562 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:43.980562 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:43.980611 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 00:57:43.980668 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 00:57:43.980739 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121}
I20260806 00:57:43.980895 2430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.973799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37482 (local address 127.3.98.189:43475)
0806 00:57:43.973871 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:43.973872 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:43.973906 (+ 34us) server_negotiation.cc:407] Connection header received
0806 00:57:43.973980 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:43.973981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:43.973989 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:43.974037 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:43.974364 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.975029 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.975907 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.976212 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.976281 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.978163 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:43.978164 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:43.978165 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:43.978171 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:43.979683 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.980042 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.980043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.980044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.980132 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.980318 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.980319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.980319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.980471 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:43.980574 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:43.980707 (+ 133us) server_negotiation.cc:299] Negotiation successful
0806 00:57:43.980783 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 00:57:43.981230 2529 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } has no permanent_uuid. Determining permanent_uuid...
I20260806 00:57:43.983976 2325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.976513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53342 (local address 127.3.98.190:32843)
0806 00:57:43.976825 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:43.976828 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:43.976837 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:57:43.976858 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:43.976859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:43.976869 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:43.976934 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:43.977392 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.977858 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.978583 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.978801 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.978897 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.981319 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:43.981320 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:43.981321 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:43.981328 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:43.982812 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.983190 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.983191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.983191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.983250 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.983454 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.983455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.983455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.983591 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:43.983756 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:43.983850 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 00:57:43.983914 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288}
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.188@KRBTEST.COM for kudu/127.3.98.188@KRBTEST.COM
I20260806 00:57:43.988812 2531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.981492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40622)
0806 00:57:43.981544 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:43.981554 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:43.981594 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:43.981716 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:43.981716 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:43.981849 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:43.981874 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.981875 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.982479 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.982480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.982937 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:43.982938 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.983327 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.983328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:43.983376 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.983780 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:43.983785 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:43.985221 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:43.987745 (+ 2524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.987746 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.987747 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.987983 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.988205 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:43.988206 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:43.988207 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:43.988278 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:43.988559 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:43.988560 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:43.988609 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 00:57:43.988682 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 00:57:43.988752 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 00:57:43.988936 2535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.981553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40622 (local address 127.3.98.188:41283)
0806 00:57:43.981585 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:43.981587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:43.981595 (+ 8us) server_negotiation.cc:407] Connection header received
0806 00:57:43.981651 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:43.981651 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:43.981661 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:43.981713 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:43.981947 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.982399 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.983027 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.983243 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.983326 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.985297 (+ 1971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:43.985298 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:43.985299 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:43.985304 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:43.987661 (+ 2357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.988087 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.988088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.988088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.988137 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.988340 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.988341 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.988341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.988432 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:43.988540 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:43.988735 (+ 195us) server_negotiation.cc:299] Negotiation successful
0806 00:57:43.988808 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
Aug 06 00:57:43 dist-test-slave-44d2 krb5kdc[2206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.98.189@KRBTEST.COM
I20260806 00:57:43.990553 2529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415: Bootstrap starting.
I20260806 00:57:43.991469 2529 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:43.991849 2529 log.cc:824] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:43.992395 2430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:43.984650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37484 (local address 127.3.98.189:43475)
0806 00:57:43.984685 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:43.984687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:43.985035 (+ 348us) server_negotiation.cc:407] Connection header received
0806 00:57:43.985103 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:43.985104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:43.985111 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:43.985157 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:43.985662 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.986166 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.986782 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:43.986962 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:43.987017 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:43.989727 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:43.989728 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:43.989729 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:43.989736 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:43.991253 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.991640 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.991642 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.991642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.991712 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:43.991908 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:43.991909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:43.991909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:43.992047 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:43.992235 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:43.992274 (+ 39us) server_negotiation.cc:299] Negotiation successful
0806 00:57:43.992333 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260806 00:57:43.992964 2529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415: No bootstrap required, opened a new log
I20260806 00:57:43.993933 3466 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 00:57:43.994822 2529 raft_consensus.cc:348] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } }
I20260806 00:57:43.994951 2529 raft_consensus.cc:729] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 320e53c568244691b3de773e0b1e5415, State: Initialized, Role: FOLLOWER
I20260806 00:57:43.995042 2529 consensus_queue.cc:260] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } }
I20260806 00:57:43.995385 2529 sys_catalog.cc:564] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:43.995365 2537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } } }
I20260806 00:57:43.995486 2537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:57:43.994930 2283 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3649fc1076c849099d0d02ebdae76e80"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53342
W20260806 00:57:43.997272 2550 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 00:57:43.997392 2550 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:57:43.997516 2433 master_runner.cc:186] Error getting master registration for 127.3.98.190:32843: OK, instance_id { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" instance_seqno: 1785977863612371 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 00:57:43.999543 2433 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 00:57:44.021773 2426 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } attempt: 3
Aug 06 00:57:44 dist-test-slave-44d2 krb5kdc[2206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.189@KRBTEST.COM for kudu/127.3.98.188@KRBTEST.COM
I20260806 00:57:44.029107 2429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:44.022229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40630)
0806 00:57:44.022302 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:44.022314 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:44.022359 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:44.022548 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:44.022550 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:44.022743 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:44.022793 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:44.022795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.023464 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.023465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:44.023978 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:44.023979 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.024349 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.024351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:44.024419 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:44.024961 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:44.024966 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:44.026242 (+ 1276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:44.027965 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:44.027966 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:44.027967 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:44.028152 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:44.028367 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:44.028368 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:44.028368 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:44.028430 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:44.028750 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:44.028751 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:44.028798 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 00:57:44.028890 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 00:57:44.028997 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 00:57:44.029107 2535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:44.022325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40630 (local address 127.3.98.188:41283)
0806 00:57:44.022401 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.022403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.022412 (+ 9us) server_negotiation.cc:407] Connection header received
0806 00:57:44.022439 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.022440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.022449 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.022539 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.022893 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.023376 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.024070 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.024271 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.024352 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:44.026345 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:44.026346 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:44.026347 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:44.026354 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:44.027861 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:44.028229 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:44.028230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:44.028230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:44.028292 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:44.028510 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:44.028512 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:44.028512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:44.028674 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:44.028759 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:44.028915 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 00:57:44.029002 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 00:57:44.030905 2426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f: Bootstrap starting.
I20260806 00:57:44.031595 2426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:44.031917 2426 log.cc:824] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:44.032788 2426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f: No bootstrap required, opened a new log
I20260806 00:57:44.034240 2426 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } }
I20260806 00:57:44.034385 2426 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99d0401eb956449ebbbc653426106e1f, State: Initialized, Role: FOLLOWER
I20260806 00:57:44.034485 2426 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } }
I20260806 00:57:44.034843 2553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } } }
I20260806 00:57:44.034915 2426 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:44.034962 2553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f [sys.catalog]: This master's current role is: FOLLOWER
W20260806 00:57:44.037213 2570 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 00:57:44.037271 2570 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:57:44.037643 2332 master_runner.cc:186] Error getting master registration for 127.3.98.190:32843: OK, instance_id { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" instance_seqno: 1785977863612371 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 00:57:44.041000 2332 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 00:57:44.056203 2320 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } attempt: 3
Aug 06 00:57:44 dist-test-slave-44d2 krb5kdc[2206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785977863, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.98.190@KRBTEST.COM for kudu/127.3.98.188@KRBTEST.COM
I20260806 00:57:44.065297 2535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:44.056719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40632 (local address 127.3.98.188:41283)
0806 00:57:44.056769 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.056771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.056782 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:57:44.056813 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.056815 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.056827 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.056905 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.057439 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.058210 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.059359 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.059663 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.059736 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:44.062183 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:44.062185 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:44.062185 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:44.062193 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:44.063993 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:44.064433 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:44.064434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:44.064434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:44.064524 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:44.064739 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:44.064740 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:44.064740 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:44.064881 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:44.064952 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:44.065112 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 00:57:44.065197 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 00:57:44.065303 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:44.056629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.98.188:41283 (local address 127.0.0.1:40632)
0806 00:57:44.056693 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0806 00:57:44.056705 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 00:57:44.056752 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 00:57:44.056979 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 00:57:44.056981 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 00:57:44.057244 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0806 00:57:44.057305 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:44.057309 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.058308 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.058309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:44.059272 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 00:57:44.059275 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.059749 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.059750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 00:57:44.059819 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:44.060378 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 00:57:44.060385 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 00:57:44.062107 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 00:57:44.064088 (+ 1981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:44.064089 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:44.064089 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:44.064339 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:44.064597 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 00:57:44.064597 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 00:57:44.064598 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 00:57:44.064669 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 00:57:44.064946 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 00:57:44.064947 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 00:57:44.064997 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 00:57:44.065075 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 00:57:44.065183 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 00:57:44.067662 2320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80: Bootstrap starting.
I20260806 00:57:44.068761 2320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80: Neither blocks nor log segments found. Creating new log.
I20260806 00:57:44.069118 2320 log.cc:824] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80: Log is configured to *not* fsync() on all Append() calls
I20260806 00:57:44.070070 2320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80: No bootstrap required, opened a new log
I20260806 00:57:44.071571 2320 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } }
I20260806 00:57:44.071729 2320 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3649fc1076c849099d0d02ebdae76e80, State: Initialized, Role: FOLLOWER
I20260806 00:57:44.071818 2320 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } }
I20260806 00:57:44.072158 2320 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 00:57:44.072183 2283 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 00:57:44.072258 2283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:44.073298 2283 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } }
I20260806 00:57:44.073952 2574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } } }
I20260806 00:57:44.074295 2394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3649fc1076c849099d0d02ebdae76e80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "99d0401eb956449ebbbc653426106e1f"
I20260806 00:57:44.074461 2394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:44.075461 2394 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3649fc1076c849099d0d02ebdae76e80 in term 1.
I20260806 00:57:44.074127 2574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 00:57:44.074882 2588 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260806 00:57:44.075829 2244 leader_election.cc:302] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3649fc1076c849099d0d02ebdae76e80, 99d0401eb956449ebbbc653426106e1f; no voters:
W20260806 00:57:44.075953 2588 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 00:57:44.076154 2574 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 00:57:44.076524 2574 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [term 1 LEADER]: Becoming Leader. State: Replica: 3649fc1076c849099d0d02ebdae76e80, State: Running, Role: LEADER
I20260806 00:57:44.076629 2574 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } }
I20260806 00:57:44.079560 2224 master_runner.cc:232] Existing masters have differing terms: 1 vs 0
I20260806 00:57:44.079644 2224 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 00:57:44.079698 2574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3649fc1076c849099d0d02ebdae76e80. Latest consensus state: current_term: 1 leader_uuid: "3649fc1076c849099d0d02ebdae76e80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } } }
I20260806 00:57:44.079764 2574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:44.080240 2495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3649fc1076c849099d0d02ebdae76e80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "320e53c568244691b3de773e0b1e5415"
I20260806 00:57:44.080375 2495 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415 [term 0 FOLLOWER]: Advancing to term 1
I20260806 00:57:44.081249 2495 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3649fc1076c849099d0d02ebdae76e80 in term 1.
I20260806 00:57:44.081457 2283 leader_election.cc:288] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [CANDIDATE]: Term 1 election: Requested vote from peers 99d0401eb956449ebbbc653426106e1f (127.3.98.189:43475), 320e53c568244691b3de773e0b1e5415 (127.3.98.188:41283)
I20260806 00:57:44.083581 2592 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 00:57:44.083823 2592 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 00:57:44.093439 2495 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415 [term 1 FOLLOWER]: Refusing update from remote peer 3649fc1076c849099d0d02ebdae76e80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:44.093788 2574 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:44.094311 2325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:44.082707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53348 (local address 127.3.98.190:32843)
0806 00:57:44.082762 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.082764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.085217 (+ 2453us) server_negotiation.cc:407] Connection header received
0806 00:57:44.085372 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.085374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.085385 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.085420 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.086289 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.087094 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.088381 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.088734 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.088784 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:44.090906 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:44.090908 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:44.090908 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:44.090916 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:44.092924 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:44.093361 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:44.093363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:44.093363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:44.093425 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:44.093660 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:44.093661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:44.093661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:44.093795 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:44.093887 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:44.094120 (+ 233us) server_negotiation.cc:299] Negotiation successful
0806 00:57:44.094208 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:57:44.095114 2537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3649fc1076c849099d0d02ebdae76e80. Latest consensus state: current_term: 1 leader_uuid: "3649fc1076c849099d0d02ebdae76e80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } } }
I20260806 00:57:44.095233 2537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:57:44.095980 2394 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f [term 1 FOLLOWER]: Refusing update from remote peer 3649fc1076c849099d0d02ebdae76e80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 00:57:44.096416 2590 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 00:57:44.098308 2553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3649fc1076c849099d0d02ebdae76e80. Latest consensus state: current_term: 1 leader_uuid: "3649fc1076c849099d0d02ebdae76e80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } } }
I20260806 00:57:44.098426 2553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:57:44.099457 2590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3649fc1076c849099d0d02ebdae76e80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } } }
I20260806 00:57:44.099553 2590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:44.099926 2553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3649fc1076c849099d0d02ebdae76e80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } } }
I20260806 00:57:44.100019 2553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:57:44.100293 2601 mvcc.cc:205] Tried to move back new op lower bound from 7315365331324088320 to 7315365331258765312. Current Snapshot: MvccSnapshot[applied={T|T < 7315365331324088320}]
I20260806 00:57:44.100788 2574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3649fc1076c849099d0d02ebdae76e80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } } }
I20260806 00:57:44.100869 2574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80 [sys.catalog]: This master's current role is: LEADER
I20260806 00:57:44.101079 2605 mvcc.cc:205] Tried to move back new op lower bound from 7315365331324088320 to 7315365331258765312. Current Snapshot: MvccSnapshot[applied={T|T < 7315365331324088320}]
I20260806 00:57:44.101393 2537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3649fc1076c849099d0d02ebdae76e80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3649fc1076c849099d0d02ebdae76e80" member_type: VOTER last_known_addr { host: "127.3.98.190" port: 32843 } } peers { permanent_uuid: "99d0401eb956449ebbbc653426106e1f" member_type: VOTER last_known_addr { host: "127.3.98.189" port: 43475 } } peers { permanent_uuid: "320e53c568244691b3de773e0b1e5415" member_type: VOTER last_known_addr { host: "127.3.98.188" port: 41283 } } }
I20260806 00:57:44.101473 2537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 00:57:44.103259 2592 catalog_manager.cc:1347] Generated new cluster ID: 2a3c31c6722e4df3a20f814c08531b01
I20260806 00:57:44.103328 2592 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 00:57:44.106009 2535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:44.083041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40642 (local address 127.3.98.188:41283)
0806 00:57:44.083082 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.083084 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.088630 (+ 5546us) server_negotiation.cc:407] Connection header received
0806 00:57:44.088737 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.088738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.088750 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.088783 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.090635 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.091463 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.094600 (+ 3137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.094934 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.094981 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:44.101905 (+ 6924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:44.101906 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:44.101907 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:44.101917 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:44.104431 (+ 2514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:44.105090 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:44.105092 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:44.105092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:44.105156 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:44.105389 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:44.105390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:44.105390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:44.105526 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:44.105611 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:44.105819 (+ 208us) server_negotiation.cc:299] Negotiation successful
0806 00:57:44.105906 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:57:44.117993 2430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:44.083444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37490 (local address 127.3.98.189:43475)
0806 00:57:44.083486 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.083488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.089733 (+ 6245us) server_negotiation.cc:407] Connection header received
0806 00:57:44.089868 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.089869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.089881 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.089915 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.092688 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.093500 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.095340 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:44.095684 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:44.095730 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:44.101951 (+ 6221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 00:57:44.101952 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 00:57:44.101953 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 00:57:44.101961 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 00:57:44.109350 (+ 7389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:44.116984 (+ 7634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:44.116986 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:44.116986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:44.117068 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 00:57:44.117310 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 00:57:44.117311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 00:57:44.117311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 00:57:44.117465 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 00:57:44.117556 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:44.117778 (+ 222us) server_negotiation.cc:299] Negotiation successful
0806 00:57:44.117896 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:57:44.133512 2592 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 00:57:44.134436 2592 catalog_manager.cc:1504] Loading token signing keys...
I20260806 00:57:44.149712 2592 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3649fc1076c849099d0d02ebdae76e80: Generated new TSK 0
I20260806 00:57:44.149945 2592 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 00:57:44.171425 2430 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:44.169672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37492 (local address 127.3.98.189:43475)
0806 00:57:44.169719 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.169722 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.170689 (+ 967us) server_negotiation.cc:407] Connection header received
0806 00:57:44.170801 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.170803 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.170815 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.170864 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.171336 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37492: BlockingRecv error: recv got EOF from 127.0.0.1:37492 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260806 00:57:44.172202 2325 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:44.169930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53352 (local address 127.3.98.190:32843)
0806 00:57:44.169973 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.169976 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.171675 (+ 1699us) server_negotiation.cc:407] Connection header received
0806 00:57:44.171773 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.171774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.171785 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.171815 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.172139 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53352: BlockingRecv error: recv got EOF from 127.0.0.1:53352 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260806 00:57:44.173081 2535 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:44.170402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40656 (local address 127.3.98.188:41283)
0806 00:57:44.170441 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.170443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.172470 (+ 2027us) server_negotiation.cc:407] Connection header received
0806 00:57:44.172660 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.172662 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.172677 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.172712 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.173020 (+ 308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40656: BlockingRecv error: recv got EOF from 127.0.0.1:40656 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260806 00:57:44.175555 2430 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:44.174661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37496 (local address 127.3.98.189:43475)
0806 00:57:44.174700 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.174702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.174897 (+ 195us) server_negotiation.cc:407] Connection header received
0806 00:57:44.175006 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.175007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.175029 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.175105 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.175509 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37496: BlockingRecv error: recv got EOF from 127.0.0.1:37496 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260806 00:57:44.178552 2430 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:44.177807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37502 (local address 127.3.98.189:43475)
0806 00:57:44.177839 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.177841 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.178048 (+ 207us) server_negotiation.cc:407] Connection header received
0806 00:57:44.178142 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.178143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.178153 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.178182 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.178506 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37502: BlockingRecv error: recv got EOF from 127.0.0.1:37502 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260806 00:57:44.182416 2430 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:44.181670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37514 (local address 127.3.98.189:43475)
0806 00:57:44.181706 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.181707 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.181912 (+ 205us) server_negotiation.cc:407] Connection header received
0806 00:57:44.182009 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.182010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.182021 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.182049 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.182374 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37514: BlockingRecv error: recv got EOF from 127.0.0.1:37514 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260806 00:57:44.188308 2430 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:44.187554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37530 (local address 127.3.98.189:43475)
0806 00:57:44.187588 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.187590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.187795 (+ 205us) server_negotiation.cc:407] Connection header received
0806 00:57:44.187892 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.187892 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.187905 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.187935 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.188264 (+ 329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37530: BlockingRecv error: recv got EOF from 127.0.0.1:37530 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260806 00:57:44.198247 2430 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:44.197517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37544 (local address 127.3.98.189:43475)
0806 00:57:44.197554 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.197556 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.197761 (+ 205us) server_negotiation.cc:407] Connection header received
0806 00:57:44.197853 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.197854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.197864 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.197892 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.198198 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37544: BlockingRecv error: recv got EOF from 127.0.0.1:37544 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260806 00:57:44.216413 2430 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:44.215599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37548 (local address 127.3.98.189:43475)
0806 00:57:44.215647 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.215650 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.215810 (+ 160us) server_negotiation.cc:407] Connection header received
0806 00:57:44.215883 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.215884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.215899 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.215975 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.216337 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37548: BlockingRecv error: recv got EOF from 127.0.0.1:37548 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260806 00:57:44.250416 2430 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:44.249588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37564 (local address 127.3.98.189:43475)
0806 00:57:44.249643 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.249645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.249802 (+ 157us) server_negotiation.cc:407] Connection header received
0806 00:57:44.249880 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.249881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.249894 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.249970 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.250341 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37564: BlockingRecv error: recv got EOF from 127.0.0.1:37564 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260806 00:57:44.316440 2430 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:44.315709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37580 (local address 127.3.98.189:43475)
0806 00:57:44.315766 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.315768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.315874 (+ 106us) server_negotiation.cc:407] Connection header received
0806 00:57:44.315926 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.315927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.315938 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.315991 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.316360 (+ 369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37580: BlockingRecv error: recv got EOF from 127.0.0.1:37580 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260806 00:57:44.446539 2430 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:44.445758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37590 (local address 127.3.98.189:43475)
0806 00:57:44.445841 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.445845 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.445971 (+ 126us) server_negotiation.cc:407] Connection header received
0806 00:57:44.446057 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.446058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.446070 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.446114 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.446477 (+ 363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37590: BlockingRecv error: recv got EOF from 127.0.0.1:37590 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260806 00:57:44.704522 2430 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 00:57:44.703859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37592 (local address 127.3.98.189:43475)
0806 00:57:44.703926 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:44.703927 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:44.703938 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:57:44.704023 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:44.704024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:44.704035 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:44.704082 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 00:57:44.704428 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37592: BlockingRecv error: recv got EOF from 127.0.0.1:37592 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 00:57:44.997897 2550 catalog_manager.cc:1259] Loaded cluster ID: 2a3c31c6722e4df3a20f814c08531b01
I20260806 00:57:44.997982 2550 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415: loading cluster ID for follower catalog manager: success
I20260806 00:57:44.998867 2550 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415: acquiring CA information for follower catalog manager: success
I20260806 00:57:44.999192 2550 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 320e53c568244691b3de773e0b1e5415: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 00:57:45.037765 2570 catalog_manager.cc:1259] Loaded cluster ID: 2a3c31c6722e4df3a20f814c08531b01
I20260806 00:57:45.037937 2570 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f: loading cluster ID for follower catalog manager: success
I20260806 00:57:45.038865 2570 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f: acquiring CA information for follower catalog manager: success
I20260806 00:57:45.039222 2570 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 99d0401eb956449ebbbc653426106e1f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 00:57:45.220745 2703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:45.217897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37604 (local address 127.3.98.189:43475)
0806 00:57:45.218042 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:45.218044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:45.218059 (+ 15us) server_negotiation.cc:407] Connection header received
0806 00:57:45.218183 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:45.218184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:45.218249 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:45.218346 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:45.218514 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:45.219046 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:45.219842 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:45.220069 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:45.220155 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:45.220350 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:45.220465 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:45.220588 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:45.220618 (+ 30us) server_negotiation.cc:299] Negotiation successful
0806 00:57:45.220640 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":67,"threads_started":1}
I20260806 00:57:45.225023 2713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:45.222636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40658 (local address 127.3.98.188:41283)
0806 00:57:45.222744 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:45.222745 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:45.222755 (+ 10us) server_negotiation.cc:407] Connection header received
0806 00:57:45.222792 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:45.222793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:45.222828 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:45.222972 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:45.223059 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:45.223565 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:45.224271 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:45.224567 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:45.224626 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:45.224750 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:45.224852 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:45.224904 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:45.224941 (+ 37us) server_negotiation.cc:299] Negotiation successful
0806 00:57:45.224957 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":58,"threads_started":1}
I20260806 00:57:45.229831 2713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:45.227010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40664 (local address 127.3.98.188:41283)
0806 00:57:45.227049 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:45.227051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:45.227102 (+ 51us) server_negotiation.cc:407] Connection header received
0806 00:57:45.227176 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:45.227177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:45.227187 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:45.227236 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:45.227370 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:45.228057 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:45.228917 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:45.229211 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:45.229273 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:45.229424 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:45.229461 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:45.229526 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:45.229723 (+ 197us) server_negotiation.cc:299] Negotiation successful
0806 00:57:45.229743 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 00:57:45.229887 2703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:45.226686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37616 (local address 127.3.98.189:43475)
0806 00:57:45.226738 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:45.226745 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:45.226914 (+ 169us) server_negotiation.cc:407] Connection header received
0806 00:57:45.227023 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:45.227024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:45.227035 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:45.227063 (+ 28us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:45.227263 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:45.228022 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:45.229082 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:45.229369 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:45.229432 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:45.229605 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:45.229636 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:45.229690 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:45.229789 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 00:57:45.229811 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 00:57:45.230218 2722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 00:57:45.226703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53362 (local address 127.3.98.190:32843)
0806 00:57:45.226825 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0806 00:57:45.226827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 00:57:45.226838 (+ 11us) server_negotiation.cc:407] Connection header received
0806 00:57:45.226896 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 00:57:45.226898 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 00:57:45.226950 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 00:57:45.227203 (+ 253us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 00:57:45.227249 (+ 46us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:45.227786 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:45.228855 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 00:57:45.229154 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 00:57:45.229221 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 00:57:45.229418 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 00:57:45.229530 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 00:57:45.229609 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 00:57:45.230119 (+ 510us) server_negotiation.cc:299] Negotiation successful
0806 00:57:45.230144 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":68,"threads_started":1}
I20260806 00:57:45.231828 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 2224
I20260806 00:57:45.244864 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 2332
I20260806 00:57:45.252825 3466 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksA1zh9/build/release/bin/kudu with pid 2433
2026-08-06T00:57:45Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3318 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6430 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (285937 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST